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This  dissertation  takes  a global  approach  to  the  processing  of  infor- 
mation from  an  array  of  sensors.  Essentially,  the  unprocessed  outputs  of 
the  individual  elements  are  considered  as  the  observables.  The  processor 
structure  is  allowed  to  evolve  freely  with  the  sole  restriction  being  the 
criterion  of  optimality. 

Specifically,  the  array  processors  discussed  must  decide  if  the  random 
processes  observed  at  the  array  element  outputs  consist  of  a signal  obscured 
by  noise  or  noise  alone.  Any  uncertain  parameters  are  treated  as  random 
variables  and  knowledge  about  them  is  summarized  by  a priori  probability 
density  functions.  The  resulting  detectors  are  optimum  in  the  sense  of 
making  a least-risk  decision. 

The  general  form  of  the  likelihood  ratio  is  derived  based  upon 
observables  consisting  of  the  Fourier  coefficients  of  the  observed  random 
processes.  For  a stationary  noise  field  consisting  „f  a component  indepen- 
dent from  sensor  to  sensor  and  an  additive  directional  component,  the 
covariance  properties  of  these  Fourier  coefficients  are  pursued  as  a 
function  of  the  observation  period  length. 

Once  the  mathematics  of  the  likelihood  ratio  has  been  written,  the 
optimal  array  processor  can  be  implemented  in  various  structures.  Four 
such  canonical  implementations  are  discussed:  (1)  one  shot,  (2)  pseudo 

estimator,  (3)  two  step,  and  (4)  sequential.  The  pseudo  estimator 
structure  is  shown  to  be  the  optimal  counterpart  of  an  appealing  ad^  hoc 
approach  to  array  processor  design  where  any  uncertain  parameters  are 
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first  estimated,  then  plugged  into  the  parameters  known  likelihood  ratio 
as  if  they  were  known  exactly.  The  general  formulation  of  the  time  sequen- 
tial structure  reveals  that  the  likelihood  ratio  can  be  realized  by  an 
appropriate  combination  of  single  freauency  components.  Each  is  an 
independent  time  sequential  processor  which  utilizes  its  own  natural 
conjugate  prior  to  achieve  a certain  degree  of  mathematical  tractability. 

Of  particular  interest  are  three  specific  problems  involving  either 
signal  or  noise  source  location  uncertainty 

(1)  Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD) 

(2)  Signal  Known  Except  for  Direction  in  Noise  with  an  Additive 
Directional  Noise  Component  of  Known  Direction  (SXED  in  NKD) 

(3)  Signal  Known  Exactly  in  Noise  with  an  Additive  Directional 
Noise  Component  of  Uncertain  Direction  (SKE  in  NUD\ 

Their  likelihood  ratio  expressions  are  derived  and  performance  reported  for 
several  levels  of  location  uncertainty  and  two  array  sizes.  Performance 
is  stated  in  terms  of  the  ROC  curve. 

Although  an  estimate  and  plug  structure  is  appealing  due  to  its  explicit 
adaptive  characteristics,  it  is  shown  that  the  optimal  array  processor 
exhibits  learning  or  adaptive  features  naturally  when  implemented  sequen- 
tially. Computer  simulation  runs  of  the  SKE  in  NUD  processor  are  used  to 
illustrate  the  Bayesian  updating  which  occurs  as  an  integral  part  of  the 
sequential  structure. 
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time  delay  of  the  directional  noise  between  adjacent  elements 
of  a uniformly  spaced  linear  array 

time  delay  of  the  directional  noise  between  the  Jt**1  and  k**1 
array  elements 

one-dimensional  parameter  space  in  the  SKEP  problem 
uncertain  parameter  (phase)  in  the  SKEP  problem 
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Glossary  of  Symbols  (continued) 


the  radian  frequency  variable 

2tt/T  or  2ir/T.  (fundamental  radian  frequency) 
inc 


magnitude  squared  of  the  complex  argument 


summation 


multiplication 


/q( • )d0_  multiple  integration  over  the  parameter  space 

- approximately  equal  to 

-*■  approaches 

<;~j>  Fourier  transform  pair 

€ membership 

C inclusion 

* conjugate  transpose 

circumflexes  denote  estimates  of  the  true  values 
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THE  SEQUENTIAL  IMPLEMENTATION  OF  ARRAY  PROCESSORS 
WHEN  THERE  IS  DIRECTIONAL  UNCERTAINTY 
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Chapter  I 

i 

INTRODUCTION  AND  OVERVIEW  (_ 

! 

The  utilization  of  an  array  of  sensors  to  obtain  some  degree  of  spatial 
filtering  or  directional  sensitivity  is  well  known.  Most  of  the  antenna  1 

array  literature  concerns  itself  with  beam  patterns  achieved  through  various 
weightings  and  location  geometries  of  the  individual  elements.  Thus,  it  is 
not  surprising  that  the  approach  to  processing  information  from  an  array  of 
sensors  usually  has  involved  beamforming  as  a basis.  While  such  an  approach 

seems  quite  logical,  it  inherently  assumes  that  operations  which  appear  j 

) 

correct  locally  (beamforming,  for  instance)  will  facilitate  the  overall 

goal  of  good  signal  processing.  j 

A global  approach  to  the  processing  of  information  from  an  array  of 
sensors  takes  another  point  of  viev-  Essentially,  the  unprocessed  outputs 
of  the  individual  elements  are  considered  as  the  observables.  Based  upon  ■ 

some  criterion  of  optimality,  the  processor  structure  is  allowed  to  evolve 
freely  out  of  the  mathematics  of  the  problem  being  considered.  Beamforming  j 

may  be  an  integral  part  of  the  resulting  structure,  but  it  is  not  imposed 

1 

from  the  beginning. 

The  array  processors  discussed  in  this  dissertation  are  derived  from 
within  such  a global  framework.  Specifically,  they  must  decide  if  the 
random  processes  observed  at  the  array  element  outputs  consist  of  a signal 
obscured  by  noise  or  noise  alone.  Any  uncertain  parameters  in  the  problems 
considered  are  treated  as  random  variables  and  knowledge  about  them  is 

[2] 


3 


summarized  by  a priori  probability  density  functions.  The  resulting 
detectors  are  optimum  in  the  sense  of  making  a least-risk  decision.  This 
approach  has  become  known  as  the  Bayesian  design  philosophy. 

Major  contributions  of  this  work  are  in  two  areas.  First,  the  time 
sequential  optimal  array  processor  is  formulated  in  general  terms  and  its 
natural  adaptive  feature  is  noted.  Second,  the  optimal  array  processors 
are  derived  and  their  performance  reported  for  three  specific  problems 
involving  either  signal  or  noise  source  loca* uncertainty. 

Detection  theory  from  a Bayesian  point  of  view  is  reviewed  in  Chapter 
II.  The  likelihood  ratio  is  introduced  as  the  optimum  processor  for  any 
goodness  criterion  where  good  decisions  are  preferred  over  bad.  Then,  four 
canonical  structures  in  which  the  likelihood  ratio  may  be  implemented  are 
discussed.  Lastly,  evaluation  of  performance  for  optimal  processors  is 
considered. 

The  general  signal  detection  theory  results  of  Chapter  II  are  special- 
ized in  Chapter  III  to  the  optimal  processing  of  data  from  an  array  of 
sensors.  A review  of  the  related  literature  is  presented  followed  by  a 
discussion  on  the  utilization  of  the  Fourier  coefficients  of  the  observed 
random  processes  as  observables  for  an  optimal  array  processor.  The 
likelihood  ratio  based  on  these  Fourier  coefficients  is  derived  and  its 
implementation  in  terms  of  three  of  the  canonical  structures  mentioned 
above  is  discussed.  An  important  comparison  is  made  between  the  optimal 
and  a popular  ad  hoc  approach  to  the  estimate  and  plug  array  processor. 

In  preparation  for  a discussion  on  the  time  sequential  implementation 
of  the  optimal  array  processor,  Chapter  IV  considers  the  covariance  between 
the  Fourier  coefficients  as  a function  of  the  observation  period  length. 
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Specific  results  for  a noise  field  consisting  of  a component  independent 
from  sensor  to  sensor  and  an  additive  directional  component  are  given. 

Chapter  V presents  the  general  formulation  cf  the  time  sequential 
optimal  array  processor.  A canonical  structure  is  derived  where  it  is 
shown  that  the  likelihood  ratio  may  be  realized  by  an  appropriate  combina- 
tion of  single  frequency  components.  For  the  particular  noise  field 
described  above,  conditions  are  given  for  the  selection  of  an  incremental 
observation  pefiod  length. 

Three  specific  detection  problems  where  there  is  either  signal  or 
noise  source  location  uncertainty  are  the  subject  of  Chapter  VI.  Their 
parameter  conditional  joint  density  expressions  are  derived  and  the 
essential  features  of  each  is  illustrated. 

A generalized  approach  to  the  analysis  of  performance  for  optimal 
processors  is  discussed  in  Chapter  VII.  The  utilization  of  sufficient 
statistics  as  an  intermediate  step  between  the  observables  and  the  likeli- 
hood ratio  is  shown  to  be  advantageous  when  performance  for  more  than  one 
pair  of  a prior  probability  density  functions  is  desired. 

Chapter  VIII  contains  a presentation  and  detailed  discussion  of 
performance  results  for  the  three  specific  problems  mentioned  above. 

Several  observations  comparing  the  relative  seriousness  of  signal  and 
noise  source  location  uncertainty  are  made. 

The  natural  adaptive  feature  of  an  optimal  array  processor  when  imple- 
mented sequentially  is  considered  again  in  Chapter  IX.  Computer  simula- 
tion runs  where  the  directional  noise  source’s  location  is  uncertain  are 
used  to  illustrate  the  Bayesian  updating  which  occurs  as  an  integral  part 
of  the  sequential  structure.  Several  noise-to-noise  ratios  are  investigated. 

Lastly,  Chapter  X provides  a summary  of  this  work  and  suggestions  for 
further  research. 
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Chapter  II  g 

BAYESIAN  SIGNAL  DETECTION  THEORY 

Within  the  communications  context,  the  two  broad  subjects  of  signal 
detection  and  estimation  theory  are  concerned  with  decision  making  based 
upon  operations  performed  on  some  received  data.  In  the  first,  only  a 
decision  about  the  presence  or  absence  cf  a certain  signal,  or  s-'bset  of 
signals,  in  the  data  is  required.  In  the  second,  the  decision  involves 
estimating  one  or  several  parameters  which  are  contained  in  the  data. 

Processors  for  these  tasks  are  designed  based  on  some  criterion  of  goodness 
or  optimality.  The  viewpoint  in  this  dissertation  will  be  Bayesian  where 
any  uncertain  parameters  are  modeled  as  random  variables  and  knowledge  about 
them  is  summarized  by  a priori  probability  density  functions. 

The  following  sections  will,  provide  the  mathematical  framework  of 
signal  detection  theory  from  which  we  will  work.  Important  concepts  to  be 
emphasized  are:  (1)  the  likelihood  ratio,  (2)  processor  structure,  and 

(3)  performance.  Parts  of  the  presentation  will  closely  follow  a recent 
excellent  paper  by  Birdsall  and  Gobien  (Birdsall  and  Gobien,  1973). 

The  Likelihood  Ratio 

Consider  the  binary  decision  problem  where  there  are  two  mutually 
exclusive  and  exhaustive  hypotheses,  and  H^.  Assume  a vector  of  obser- 
vations R is  made  from  a space  7^.  Under  H^,  the  distribution  on  71  is 
characterized  by  a probability  density  conditioned  on  a vector  of  param- 
eters which  belongs  to  the  family  {p(RJ£q>Hq)  ; 6q  € 0Q}.  Under  H^, 
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~trrr? 


the  density  belongs  to  the  family  {p(R|£1»H1>  ; 0^  € ®^K  There  may  be 


components  of  6^  and  0_^  which  represent  the  same  parameters . In  summary 


*0  ! P«lv  V 

H1  : p(R|£lS  Hx) 


io€Qo 


(2.1) 


* !i€V 


Based  upon  the  observation  vector,  the  processor  must  make  a decision 
(Dq  or  D^)  as  to  which  hypothesis  it  believes  is  true.  Classical  detection 
theory  has  shown  that  decisions  based  upon  the  likelihood  ratio  are  optimum 
for  a wide  range  of  goodness  criteria  (Peterson,  Birdsall,  and  Fox,  1954  ; 
Middleton  and  Van  Meter,  1954) 

D, 

(2.2) 


A P(£lHi>  >* 


Birdsall  has  shown  more  generally  that  any  optimality  criterion  based  on 
"detection  probability"  P(D^|h^)  and  "false  alarm  probability"  P(D^|hq) 
where  good  decisions  are  preferred  over  bad  leads  to  the  calculation  of 
A(R)  as  the  decision  statistic  (Birdsall,  1973).  Thus,  a separation  is 
achieved  between  the  processing  of  R and  the  actual  optimality  criterion 
chosen  which  arises  in  the  selection  of  a threshold  value  n. 

The  situation  may  arise  where  one  or  several  of  the  conditioning 


parameters  in  either  or  both  0^  and  0^  are  uncertain.  These  are  then 


modeled  as  random  variables  and  any  prior  knowledge  about  them  is  sum- 
marized by  a priori  probability  density  functions  p(£q)  and  p(0^).  The 
desired  decision  statistic  now  becomes  the  likelihood  ratio  of  marginal 
probability  density  functions  on  % 
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(2.3) 


Processor  Structure 

Once  the  mathematics  of  the  likelihood  ratio  has  been  written,  any 
realization  of  A(R)  will  achieve  identical  results.  None  the  less,  struc- 
turing the  processor  in  various  ways  often  can  be  advantageous  from  the 
standpoint  of  any  potential  insight  gained,  comparison  with  non-Bayesian 
approaches  to  a similar  problem,  or  the  desire  of  greater  feasibility  and 
flexibility  of  implementation.  Already  considered,  the  one  shot  processor 
simply  calculates  A(R)  as  shown  in  (2.3).  Three  other  specific  structures 
to  be  discussed  are:  (1)  pseudo  estimator,  (2)  sequential,  and  (3)  two 

step. 

The  pseudo  estimator  structure  is  actually  a particular  case  of  a more 
general  class  of  structures  resulting  from  the  application  of  Bayes'  rule 

_ p(R|0.)?(£) 


p(0|R) 


pOO 


(2.4) 


Here  the  a posteriori  probability  density  function  of  0 is  calculated  based 
on  the  observation  vector  R and  the  prior  knowledge  p(£) . The  marginal 
dens'tj  appearing  in  the  denominator  of  (2.4)  is  simply  a normalizing 


constant 


p(R)  = L p(R|£')p(0’)d0' 


(2.5) 


Utilizing  Bayes'  rule  in  (2.3),  the  likelihood  ratio  may  be  written  as 


A(*}  = A(*lil’V 


(2.6) 
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where 


p(r|6  ,h  ) 
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i.e.,  the  parameters  known  likelihood  ratio.  Note  that  any  convenient, 
admissible  value  of  the  parameters  may  be  used  to  evaluate  (2.6). 

A pseudo  estimator  structure  results  if  values  for  0^  and  0^  may  be 
found  such  that 

PfijWlol&V 


p<Vp<I:lI5.’hi> 


= i . 


(2.7) 


Solution  values  thus  chosen  for  0^  and  0^  are  called  pseudo  estimates 
(Jaarsma,  1969).  One  value  of  such  a structure  is  for  the  purpose  cf 
comparison  with  other  ad  hoc  processors  where  some  estimation  scheme  is 
joined  with  the  parameters  known  likelihood  ratio  to  yield  a subopt imal, 
but  perhaps  easily  implementable , receiver  design  (Hatsell  and  Nolte,  1974). 

A second  approach  to  processing  the  observation  vector  is  to  do  so 
sequentially,  i.e.,  the  processor  operates  on  one  or  a small  block  of 
observations  at  a time  in  a serial  fashion  until  all  the  data  has  been 
exhausted.  Consider  a vector  of  dimension  K 


K 


p<V  = IT  p(Ril%_1) 

i=l 


(2.8) 


An  expression  for  p(R^|R.  ^)  is  desired.  Assuming  parameter  conditional 
independence 


p(R.(Ri_1)  = Je  p(R.|Ri_1,e)p(e|R._1)d0 

= Je  P^iliWilRi.^de 


(2.9) 


where  p(0 |R^  ,)  is  an  updated  version  of  the  a priori  probability  density 
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function  of  0 


p(R-  JDpCejR,  9) 

p'»lSi-i>  ■ Rr^r7 


(2.10) 


The  expressions  (2.8),  (2.3),  and  (2.10)  when  conditioned  on  and  HQ  are 
the  design  equations  used  to  obtain  the  marginal  distributions  in  (2.2)  for 
K iterations.  In  general,  the  numerator  and  denominator  equations  in  (2.2) 
must  remain  separated  in  the  updating  sequence. 

Principal  advantages  gained  in  structuring  a processor  sequentially 
include  no  need  to  specify  the  actual  total  observation  length  and  the 
inherent  learning  or  adaptive  nature  of  the  processor  through  the  iterative 
updating  of  its  a priori  knowledge  of  the  uncertain  parameters.  Furthermore, 
Nolte  has  shown  that  it  may  be  necessary  to  implement  some  processors 
sequentially  in  order  to  avoid  feasibility  problems  such  as  a growing 
memory  requirement  (Nolte,  1965;  Nolte,  1966) 

The  final  processing  structure  to  be  discussed  concerns  a two  step 
approach  proposed  by  Birdsall  (Birdsall,  1968;  Birdsall  and  Gobien,  1973). 

In  the  primary  processor,  the  observation  vector  is  processed  in  conjunction 
with  any  convenient  densities  (subject  to  minor  restrictions)  substituted 
for  the  actual  a priori  knowledge.  The  output  of  the  primary  processor 
is  utilized  by  the  secondary  processor  along  with  the  true  a^  priori 
knowledge  to  calculate  the  likelihood  ratio.  A more  detailed  description 
will  require  introducing  the  concepts  of  sufficient  statistics  and  repro- 
ducing densities.  These  concepts  will  be  most  important  in  the  development 
of  later  chapters  in  this  dissertation. 

From  a Bayesian  point  of  view,  a fixed  finite  dimensional  sufficient 
statistic  of  the  observation  for  an  unknown  parameter  vector  would  be 


defined  as 


pCQjR^)  = p(£|£(RK))  , for  ail  R^. 
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Thus , the  statistic  6_(R^)  contains  as  much  information  about  £ as  do  the 
observations  themselves.  Furthermore,  the  dimension  of  6_(R^)  remains 
constant  even  as  the  dimensionality  of  the  observation  vector  increases. 

The  classical  factorization  theorem  prc-vUes  conditions  for  identifying 
a sufficient  statistic. 

Theorem  2.1  Let  p(R^i£)  be  the  conditional  density  and  5(1^)  the  fixed 
finite  dimensional  statistic  as  defined  previously.  Then  6(R^)  is  sufficient 
for  6_  if  there  exist: 

(1)  a function  g[6CR^) ,£]  which  depends  on  the  observation  only 
through  Si') , and 

(2)  a function  G(R^)  which  does  not  depend  on  £,  such  that 

pQ^le)  = g(Rj^)  . (2.12) 

Consider  the  following  example  to  illustrate  this  concept.  The  observations 

consist  of  an  unknown  scalar  0 added  to  independent  samples  n^  drawn 

2 

from  a distribution  N(0,o  ). 

R.  = 0 + n.  i = 1,2, . . . 

l l 

Since  the  observations  are  parameter  conditionally  independent,  their  joint 
distribution  may  be  written  and  factored  as  follows 

K 


pCRjJe)  = IT  p(Rile) 


i=l 


2 1 r 2 1 2 n 

= (2 *a)  exp[ — ==■  l R7]  • exp[-  (K0  - 20  £ R.)] 

2a  i=l  1 2a  i=l  1 
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where 


KV 


= G(R^)  gCSO^),©] 
K T 

= CK,  I R.f  . 

1 = 1 


(2,13) 


pa 


i 


0 

0 

Q 

0 


0 

0 

0 

It 


w 


ilTi 


11 


By  simply  applying  Bayes*  rule,  we  can  show  that  if  £(R^)  is  sufficient  for 

is  independent  of  R^. 
Substituting  (2.12)  into  (2.4)  we  see  that  G(R^)  cancels  between  the 
numerator  and  denominator  leaving 


£,  then  the  a posteriori  density  of  £ given  £(R^,) 


g[6(Rj.),e]p(e) 

P(®.I^k)  * ~ • (2.14) 

Jq  (numerator)  d£ 


Next,  we  wish  to  consider  a definition  and  theorem  on  reproducing  density 
functions  (Birdsall  and  Gobien,  1973). 

Definition  2.1  Let^p(0)  = {h(£;y)  ; yCTcR111,  £€0}  be  a family  of  pdf's  on 
0 which  is  indexed  by  the  m-dimensional  parameter  y.  Wr(e>  is  said  to  be 
a reproducing  class  of  probability  densities  under  p(R^|£)  if,  for  any  K, 
whenever  the  a priori  pdf  on  0 is 

P'(0)  = h(£;x°)  , y°  C r 

K K o 

there  exists  a Y = Y (y°  ,R^)€  f such  that  the  a posteriori  pdf  is 

p^el^)  = h(0,YK)  , /c  r . 

Thus , the  a posteriori  pdf  remains  in  the  same  family  of  functions  as  the 
a priori  pdf,  differing  only  in  the  values  of  the  parameters  characterizing 
members  in  the  family.  Primes  will  be  used  to  signify  that  we  are  within 
the  class  of  natural  reproducing  densities. 


Theorem  2.2  Suppose  p(R^|£)  admits  a sufficient  statistic  of  fixed 
dimension  £(R^)  for  £ and  hence  can  be  factored  as  in  (2.12);  let  the 
function  g(*,*)  be  as  defined  there,  and,  provided  the  integral  exists,  put 


P’(£;X> 


gtl»£3 

Je  gCx,£']d£' 


, yct 


(2.15) 


where  r is  the  image  of  the  space  of  observations  under  £(♦).  Then 
{p'(0_;x)  ; is  a reproducing  class  of  densities  under  p ( 1 6_) . 

The  class  thus  defined  is  called  the  natural  conjugate  class  of  pdf*s 
under  p(R^|0);  existence  of  a sufficient  statistic  implies  existence  of 

I\  ‘ 

such  a class. 

It  is  possible  that  the  natural  conjugate  class  may  not  contain  a 
member  suitable  for  describing  the  true  a_  priori  knowledge.  However, 
suppose  the  true  a priori  pdf  on  0 can , for  some  jm6  F » be  written 

p(£)  * r(0)p‘(e;YQ)  (2.16) 

where  r(£)  is  a nonnegative  function  defined  on  0 and  p(£)  is  absolutely 
continuous  with  respect  to  P'(0>Y^)-  Since  p'(£;jr°)  is  reproducing,  a 
simple  application  of  Bayes*  rule  (2.4)  reveals  that  p(6)  also  reproduces 
with  parameter  j 

r(0)p*(0;YK) 

p(0|RK)= . (2.17) 

Jq  (numerator)  d£ 

K 

Utilizing  (2.17)  and  a Bayes*  rale  substitution  for  p*(0.;x  ),  the  marginal 
distribution  of  given  the  true  a priori  knowledge  can  be  written  in 
terms  of  the  natural  conjugate  class  of  densities  and  r(£) 

p(Rj<)  = P’%)  /0  r(0)p'(0;xK)  d£  . (2.18) 


The  mathematical  description  of  the  two  step  approach  to  processor 
structure  now  can  be  completed.  The  primary  processor  uses  a convenient 
description  of  a priori  knowledge  out  of  the  class  of  natural  conjugate 
densities  (if  such  a class  exists).  The  secondary  processor  utilizes 
the  likelihood  ratio  calculated  on  the  basis  of  these  densities  together 
with  the  resulting  sufficient  statistics  characterizing  the  a posteriori 
pdf's  and  the  true  a priori  knowledge  to  calculate  the  true  likelihood  ratio 


The  benefit  of  such  an  approach  to  receiver  design  is  that  potentially  a 
major  portion  of  the  processor  can  be  designed  without  knowing  the  exact 
£ priori  knowledge.  Furthermore,  the  mathematical  tractability  of  the 
natural  conjugate  priors  may  simplify  the  design  of  the  primary  processor 


Performance 

The  complete  description  of  a detection  device  includes  both  the 
processor  itself  (i.e.,  the  mathematical  transformation  from  observation 
space  to  decision  statistic)  and  the  performance  of  the  processor  evaluated 
with  respect  to  the  goodness  criterion  initially  chosen.  As  mentioned 
earlier,  the  likelihood  ratio  has  been  shown  optimum  for  any  goodness 
criterion  based  on  "detection  probability"  and  "false  alarm 

probability"  PCdJHq)  where  good  decisions  are  preferred  over  bad.  Thus, 
the  appropriate  description  of  performance  for  a likelihood  ratio  computing 
device  is  its  detection  and  false  alarm  probabilities  as  a function  of 
decision  threshold.  The  precise  definition  of  these  terms  (which  arise 
from  within  a RADAR  and  SONAR  context)  now  will  be  given. 

Since  the  likelihood  ratio  is  simply  a transformation  of  random  vari- 
ables (the  observation  vector  R)  to  a one  dimensional  decision  statistic 
(A(R)),  the  likelihood  ratio  itself  will  be  a random  variable  whose 
probability  density  function  will  depend  on  which  hypothesis  (HQ  or  H^) 
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is  actually  active  on  7?.  Recalling  frcm  (2.2)  that  the  threshold  n divides 
the  decision  space,  define 


PD  * p(D  |H1)  = / p( A | H ) dA  (2.20) 

n 1 

00 

PF  = pCdJHq)  n / p(A|H0)  dA  . (2.21) 


Peterson,  Birdsall,  and  Fox  introduced  a graphical  representation  of 
versus  P^  as  a function  of  n known  as  the  ROC  (receiver  operating  charac- 
teristic) curve  (Peterson,  Birdsall,  and  Fox,  1954).  The  ROC  curve  will 
be  the  means  by  which  performance  of  the  detection  receivers  discussed  in 
this  dissertation  will  be  evaluated  and  compared. 

In  general,  the  entire  ROC  curve  is  necessary  to  completely  specify 
performance.  However,  in  the  classic  SKE  in  WGN  problem  (H^:  signal  known 
exactly  + white  Gaussian  noise  vs.  HQ:  white  Gaussian  noise  alone),  per- 
formance is  summarized  by  a single  number  known  as  the  detectability  index 
2 

d . In  this  case,  the  distribution  of  £(R)  = lnA(R)  is  Gaussian  under 
and  HQ  with  equal  variances  of  2E/NQ  and  means  separated  by  2E/NQ 
(E  = received  signal  energy,  N^/2  = noise  power  spectrum  height).  By 
definition  (Van  Trees,  1968) 


2 a - EU|H0)]2 

d = var(£|HQ) 


(2.22) 


2E 


Detection  and  false  alarm  probability  expressions  corresponding  to  (2.20) 
and  (2.21)  are 


P 


D 


erfc*0 


In  n 
d 


(2.23) 
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0 

0 


[ 


PF  = + f)  (2.24) 

« 2 

where  erfc*  = / exp(-  $>  ) dx  . (2.25) 

* /2?  2 

The  SKE  performance  curves  are  il Justrated  in  Figure  2.1  on  normal-normal 
paper.  Note  that  performance  increases  linearly  on  the  negative  diagonal 
as  a function  of  d. 

Block  Diagrams  and  Sufficient  Statistics 

From  the  preceding  discussion,  it  has  been  shown  that  once  the  likeli- 
hood ratio  was  determined,  A(R)  could  be  implemented  in  various  structures 
which  might  look  quite  different.  Perhaps  the  epitome  of  this  is  in 
Birdsall ’ s two  step  approach  where  the  primary  processor  might  take  on 
any  one  of  an  infinite  number  of  structures  depending  on  the  tractable 
prior  chosen.  Nevertheless,  it  is  quite  common  for  those  of  us  engaged 
in  optimum  receiver  design  to  look  for  structural  pieces  in  our  particular 
realization  of  A(R)  that  might  be  either  the  same  as,  or  in  contrast  to, 
structure  arrived  at  by  other  ad  hoc  approaches  to  the  same  problem.  The 
contention  here  is  that  perhaps  too  much  emphasis  has  been  placed  in  the 
past  on  the  overall  structure  of  A(R)  instead  of  some  more  fundamental 
component  pieces.  A solution  for  the  likelihood  ratio  not  in  closed 
form  always  has  appeared  only  half  completed. 

The  expression  in  (2.3)  shows  that  the  fundamental  components  of 
A(R)  before  the  introduction  of  a particular  a jr  'ori  knowledge  are  the 
conditional  densities  of  I*  under  H1  and  HQ.  Assuming  p(R.|£)  admits  a 
sufficient  statistic  for  (2.12)  shows  that  the  two  basic  building  blocks 
are  the  sufficient  statistic  6_(R)  and  G(R).  In  general,  no  matter  what 
a priori  knowledge  is  chosen,  6(A)  and  G(R)  will  have  to  be  calculated 
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under  and  Hq.  Any  final  structure  of  A(R)  will  always  be  a function  of 
these  basic  parts  and  it  is  their  structure  which  will  provide  the  most 
fundamental  basis  from  which  comparison  with  other  detectors  can  be  made. 
As  an  example,  a recent  paper  by  Adams  and  Nolte  derives  and  discusses  the 
interpretation  of  these  basic  components  for  optimum  array  processors  in 
fluctuating  ambient  noise  fields  (Adams  and  Nolte,  1975). 


Chapter  III 

OPTIMUM  ARRAY  PROCESSING 


A rigorous  approach  to  signal  detection  theory  from  a Bayesian  point 
of  view  has  been  established.  The  desire  now  is  to  apply  these  general 
concepts  to  the  optimal  processing  of  data  from  an  array  cf  sensors.  It 
should  be  emphasized  that  the  Bayesian  approach  is  global  in  the  sense 
that  no  processing  structure  (such  as  a beam  former)  is  assumed  from  the 
beginning.  Rather,  the  mathematics  (which  results  in  structure)  is  allowed 
to  evolve  freely  cut  of  the  problem  statement  with  the  unprocessed  outputs 
of  each  array  element  taken  as  observables.  Furthermore,  since  the  like- 
lihood ratio  will  be  used  as  the  decision  statistic,  the  only  complete 
description  of  array  processor  performance  will  be  in  the  form  of  an  ROC 
curve. 

The  particular  interest  in  this  dissertation  will  be  the  general 
formulation  of  sequential  array  processors  when  there  is  directional 
uncertainty.  Cases  will  be  considered  where  there  is  both  a far  field 
directional  signal  source  and  noise  source  in  addition  to  an  independent 
additive  noise  component  at  each  array  element. 

Literature  Review 

The  Bayesian  approach  to  array  processing  has  been  discussed  in  the 
literature  since  the  early  1960’s.  Unfortunately,  there  have  been  few 
instances  where  the  likelihood  ratio  processor's  performance  has  been 
given  in  terns  of  the  ROC  curve.  Quite  often,  other  performance  measures 
are  used  (such  as  array  gain)  which  are  not  the  optimality  criterion  under 


m 
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which  the  processor  was  designed.  A brief  summary  of  the  literature  related 
to  this  dissertation  is  given  below.  An  excellent  topical  and  chronological 
review  of  optimum  array  processing  can  be  found  in  a recent  dissertation 
by  Adams  (Adams,  1973)  and  paper  by  Adams  and  Nolte  (Adams  and  Nolte,  1975). 

The  earliest  attempts  to  derive  Bayes  optimal  array  processors  assumed 
known  directional  s.  _..ual  souro  z and  noise  fields  which  at  times  contained 
a highly  directional  additive  component  of  known  location.  Bryn  was  the 
first  with  his  paper  in  1962  on  the  detection  of  a Gaussian  signal  in 
Gaussian  noise  (Bryn,  1962).  His  formulation  used  a truncated  power  series 
expansion  for  the  likelihood  ratio  which  was  optimum  at  low  signal-to- 
noise  ratios.  Unfortunately,  Bryn’s  evaluation  of  performance  was  in 
terms  of  array  gain  instead  of  detectability.  A short  time  later,  Middleton 
and  Groginsky  discussed  in  general  terns  the  same  problem  without  making  a 
low  signal-to-noise  ratio  assumption  (Middleton  and  Groginsky,  1964). 

Their  study  was  mainly  concerned  with  factorization  results  (i.e.,  the 
splitting  of  processor  structure  into  a spatial  component  independent  of 
noise  statistics  and  a component  dependent  only  on  the  statistics  of  the 
signal  and  noise  random  processes)  and  no  performance  was  given. 

Schultheiss  also  considered  the  problem  of  detecting  a Gaussian  signal 
in  Gaussian  noise  (Schultheiss,  1968).  His  analysis  centered  on  the  benefit 
of  likelihood  ratio  processing  over  conventional  beam  forming  when  a major 
component  of  the  noise  field  was  highly  directional.  True  detection 
performance  was  calculated  based  on  a low  signal-to-noise  ratio  assumption. 

Another  paper  which  quickly  followed  Bryn's  was  the  first  to  deal 
with  detecting  a signal  of  known  form  in  Gaussian  noise  (Stocklin,  1963). 
Stocklin's  work  is  to  be  noted  for  its  complete  analysis  from  likelihood 
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ratio  through  ROC  curve.  In  1964,  Merrnoz  discussed  the  same  problem  from 
a different  point  of  view  (Merrnoz,  1964).  His  approach  was  to  postulate 
a linear  structure  consisting  of  filters  at  each  array  element  whose 
outputs  were  then  summed  together.  The  filter  transfer  functions  were 
calculated  which  maximized  the  signal-to-noise  ratio  at  the  summing  junc- 
tion. For  this  particular  problem,  the  resulting  processor  is  identical 
to  that  of  the  Bayes  optimal  array  processor.  As  in  Middleton's  and 
Groginsky's  work,  a major  contribution  of  this  paper  was  in  its  factori- 
sation results.  Merrnoz 's  analysis  also  is  presented  in  a book  by  Horton 
(Horton,  1969). 

Several  years  later,  the  solutions  due  to  both  Bryn  and  Merrnoz  were 
rederived  by  Cox  from  within  a conmon  mathematical  framework  using  the 
Schwartz  inequality  to  maximize  the  detectability  index  (Cox,  1968;  Cox, 
1969).  Particularly  well  presented  is  the  concept  that  such  seemingly 
diverse  problems  are  actually  closely  related.  In  addition,  the  1968 
paper  gives  an  excellent  discussion  of  detection  theory  results  in  terms 
of  complex  random  vectors  with  emphasis  on  the  trigonometric  Fourier  series. 

The  incorporation  of  directional  uncertainty  into  Bayes  optimal  array 
processors  has  occurred  only  recently.  Young  and  Howard  modeled  their 
signal  as  having  a uniform  a priori  location  distribution  over  a particular 
field  of  interest  (Young  and  Howard,  1970).  Performance  was  given  in 
terms  of  average  risk.  In  addition,  average  risk  for  the  optimal  processor 
was  compared  to  that  of  the  conventional  beam  former  as  a demonstration 
of  the  latter’s  rather  severe  sensitivity  tc  location  uncertainty.  The 
next  significant  slap  was  taken  by  Gallop  and  Nolte  (Gallop,  1971;  Gallop 
and  Nolte,  19; V -'^eir  analysis  allowed  signal  location  uncertainty  to 
be  modeled  ai  : .y  on  ' ' a continuum  of  a priori  densities , extremes  of 
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which  were  uniform  knowledge  on  one  end  and  certainty  of  location  on  the 
other.  Sets  of  ROC  curves  representing  various  levels  cf  location  uncer- 
tainty were  given. 

A general  approach  to  the  derivation  of  array  processors  for  sources 
of  known  location  was  proposed  in  a paper  by  Adams  and  holte  (Adams  and 
Nolte,  1975).  Particular  emphasis  was  given  to  receiver  structure,  factor- 
ization results,  and  performance  when  the  noise  field  contained  an  additive 
component  from  a fixed  far  field  location.  Additionally,  Adams  also  has 
pursued  the  derivation  of  likelihood  ratio  expressions  where  either  the 
signal  or  directional  noise  locations  were  uncertain  (Adams,  1973).  No 
performance  for  these  cases  was  presented.  Essentially,  the  work  in  this 
dissertation  is  an  extension  of  that  by  Adams  to  the  consideration  of  the 
sequential  implementation  of  array  processors  when  there  is  directional 
uncertainty  and  the  calculation  of  performance  for  several  specific 
problems. 


Trigonometric  Fourier  Series 

The  application  of  classical  statistics  to  optimal  detection  theory 
requires  a finite  dimensional  vector  of  observables  whose  joint  probability 
density  function  under  HQ  and  is  used  to  form  the  likelihood  ratio. 
Typically,  the  array  element  outputs  will  be  a collection  of  continuous 
time  waveforms.  Some  mapping  then  must  be  used  to  carry  this  space  into 
into  a space  of  finite  dimensional  vectors.  Three  well,  known  approaches 
to  this  transformation  are:  (1)  time  sampling,  (2)  the  Karhunen-Loeve 

expansion,  and  (3)  the  trigonometric  Fourier  series.  The  selection  of 
a particular  mapping  is  heavily  problem  dependent.  A wise  choice  can 
often  greatly  simplify  the  mathematics  of  the  likelihood  ratio.  Adams 
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showed  that  the  third  approach  led  to  a significant  amount  of  tractability , 
especially  when  the  noise  field  contained  an  additive  source  in  the  far 
field  (Ada*  1973;  Adams  and  Nolte,  1975).  The  trigonometric  Fourier- 
series  will  be  used  throughout  this  dissertation.  Basic  definitions  and 
results  for  the  characterization  of  random  processes  follow  (see  also 
Papoulis,  1965,  and  Van  Trees,  1968). 

What  we  desire  is  a series  expansion  valid  for  sample  functions  z(t) 
from  a zero  mean  stationary  random  process  over  the  interval  (-T/2,T/2). 
Written  as  a Fourier  series 


N 

z(t ) = l.i.m.  I z(n)  expfjnw.t)  , |t|<T/2  ^3.1) 


N+«  n=-N 


where 


w0  = T 


T/2 

z(n)  = (^■)1^2  /*  z(t)  exp(-jnu.t)  dt  . 
T -T/2 


(3.2) 


Convergence  is  in  the  mean  square  sense  (Papoulis,  1965),  The  notation 


"l.i.m."  denotes  limit  in  the  mean  which  is  defined  as 


N ,1/2  2 

lim  E[(z(t)  - l z(n)  (~)  exp(jnw.t))  3=0,  |t|<T/2  . (3.3) 
N + -*>  n=-N 

Since  z(t)  is  a random  process,  z(n)  will  be  a randrm  variable  and 


(Papoulis,  1965) 


lim  E[z(n)z(m)*3  = 


N(no>0)  , n = m 
0 , n i m 


(3.4) 


where  N(n«g)  is  the  power  spectral  density  of  the  random  process  and 
denotes  conjugate  transpose.  Thus,  as  the  observation  interval  T increases, 
the  Fourier  coefficients  at  different  }ueney  indices  become  uncorrelated. 
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The  series  in  (3.1)  can  be  truncated  at  any  N with  a corresponding 
representation  error.  The  expression  in  (3.3)  guarantees  that  the  expected 
value  of  this  error  becomes  smaller  as  N is  increased.  Particularly  with 
bandlimited  random  processes,  (3.4)  indicates  that  the  expected  value  of 
error  will  be  negligible  when  N = 2vW/u)^  (W  the  bandwidth  in  Hz.)  for  T 
taken  sufficiently  large.  Under  these  conditions,  we  will  say  that  the 
real  sample  function  z(t)  can  be  mapped  into  the  finite  dimensional  vector 
z where 


z = [z(0),. . . ,z(N)] 


(3.5) 


the  "T"  denoting  transpose.  Coefficients  with  negative  indices  are  not 

written  since  for  real  functions  z(-n)  = z(n)  . Considering  such  a finite 

dimensional  representation,  if  z(t)  is  replaced  by  its  series  expansion  as 

in  (3.1),  then  the  energy  of  the  sample  function  over  the  observation 

interval  ( -T/2, T/2)  can  be  approximated  by 

T/2  N 

/ z(t)  • z(t)  dt  - l z(n)*  z(n)  . (3.6) 

-T/2  n=-N 


From  (3.4),  we  see  that  for  T sufficiently  large 

T/2  N 

EC/  2(t)  • z(t)  dt  ] - l N(nmn)  . 
-T/2  n=~N 


(3.7) 


The  discussion  so  far  has  emphasized  random  processes.  Convergence 

in  the  mean  square  sense  guaranteed  that  almost  every  sample  function 

could  be  represented  by  its  series  expansion.  More  strict  conditions  can 

be  applied  in  the  case  of  a deterministic  time  waveform  s(t).  Since 
1/2 

{ ( 1/T ) exp(jna>Qt)  ; n = -»,...,w)  forms  a complete  orthonormal  set, 

then  for  all  s(t)  with  finite  energy  in  the  interval  (-T/2,T/2) 


N . 1/2 

s(t)  = lim  J s(n)  (£)  exp(jnuftt)  , |t|<T/2 

N+»  -N  1 u 


(3.8) 


where 


u0  = f 


1 1/2  T/2 

(=•)  / s (t ) exp(-jnwnt) 

1 ' -T/2  0 


(3.9) 


Again,  convergence  is  in  the  mean  square  sense  with  (Vein  Trees,  1968) 

T/2  N i 1/2  2 

lim  ) Cs(t)  - l s(n)  (=r)  exp(jnu i t)]  dt  = 0.  (3.10) 

N-*»  -T/2  n=-N 


Furthermore,  the  energy  of  s(t)  over  the  observation  interval  ( -T/2, T/2)  is 


/ s(t)  • s(t)  dt  = ][  s(n)  s(n) 

-T/2  n=-  » 


(3.11) 


which  is  simply  Parseval1 s theorem. 

The  optimal  array  processors  to  be  considered  in  this  dissertation 
observe  a vector  of  real  time  waveforms  on  the  interval  ( -T/2, T/2) 


z(t)  = CzQ(t),. . . ,zK1(t)] 


(3.12) 


where  the  subscript  denotes  the  array  element.  Making  the  assumptions  that 


led  to  (3.5),  let 


! 1/2  T/2 

z^(n)  = (-)  / zk(t)  exp(-jnw0t)  dt 


(3.13) 


z(n)  = CzQ(n),. . . ,zK_1(n)] 


(3.14) 


z = [z(0)T,... ,z(N)T]T 


(3.15) 


In  this  way,  the  time  waveforms  observed  on  the  K elements  are  mapped  into 
a K*(N+1)  dimensional  vector.  Note  that  the  Fourier  coefficients  for  a 


single  frequency  index  n and  all  K elements  are  grouped  together. 
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Multivariate  Complex  Gaussian  Distributions 

The  particular  arrangement  of  Fourier  coefficients  in  the  vector  z will 
lead  to  certain  mathematical  simplifications  in  the  likelihood  ratio  calcu- 
lations to  be  discussed  later.  In  preparation,  this  section  will  develop 
the  necessary  theory  of  multivariate  complex  Gaussian  distributions.  The 
presentation  closely  follows  that  of  Adams  and  Nolte  (Adams  and  Nolte,  1975) 
which  is  based  on  Goodman  (Goodman,  1963). 

First,  we  will  need  definitions  for  complex  Gaussian  random  variables 
and  vectors.  A complex  Gaussian  random  variable  is  defined  to  be  a complex 
random  variable  whose  real  and  imaginary  parts  are  bivariate  Gaussian.  A 
complex  Gaussian  random  vector  of  dimension  p is  defined  to  be  a p-tuple  of 
complex  Gaussian  random  variables  such  that  the  vector  of  real  and  imaginary 
parts  is  2p- variate  Gaussian. 

Consider  the  complex  Gaussian  random  vector  z_  which  can  be  written 


z = x + iy_ . 


(3.16) 


Our  attention  will  be  restricted  to  complex  Gaussian  random  vectors  whose 
covariance  matricies  are  of  the  following  special  form.  Both  x and  have 


covariance  matricies  which  are  equal  to  1/2  V,  where  V is  a symmetric, 
positive  semi-definite  matrix.  The  covariance  of  x and  jr  is  assumed  equal 
to  1/2  W,  where  W is  skew  symmetric  and 


E [x  - E(x)][£  - e(£)]T  = i-W 
E [£  - E(£)][x  - E(x)]T  =--jW  ' 


(3.17) 


Under  these  conditions,  the  p-variate  complex  Gaussian  distribution  of  z_ 
is  given  by 


26 


p(z)  = — exp[-(z-m)*Q  ^(z-m)] 

- ^lal  

(3.18) 

where 

m = E{z) 

(3.19) 

and 

Q = E{(z-m)(z-m)*}  = V + iW  . 

(3.20) 

The  Likelihood  Ratio  and  Arry  Processor  Structure 

The  results  of  Chapter  II  will  now  be  rewritten  in  the  context  of 
optimal  array  processors.  The  real  random  processes  observed  at  the  output 
of  each  array  element  will  be  assumed  stationary  and  jointly  Gaussian. 

Since  (3.13)  indicates  that  the  Fourier  coefficients  at  a particular  element 
are  simply  linear  functionals  of  a Gaussian  random  process,  the  real  and 
imaginary  parts  of  each  z^(n)  will  be  bivariate  Gaussian  distributed 
(Van  Trees,  1968).  Thus,  ^(n)  is  a complex  Gaussian  random  variable. 
Furthermore,  since  the  observed  random  processes  are  jointly  Gaussian,  the 
collection  of  real  and  imaginary  parts  of  all  the  Fourier  coefficients  will 
be  jointly  Gaussian  (Van  Trees,  1968).  Thus,  z is  a complex  Gaussian 
random  vector  of  dimension  K*(N+1). 

Consider  the  array  detection  problem  where  the  observables  consist  of 
K* (N+l)  Fourier  coefficients  arranged  as  in  (3.15).  The  two  mutually 
exclusive  and  exhausive  hypotheses  will  be 


H0  ; z = n(®0) 

: £ = s(£1)  + n(0^) 


(3.21) 


where  n(^),  n(0^),  and  s(  6^ ) are  noise  and  signal  vectors  written  expli- 
citly as  functions  of  parameter  vectors  0^€  0Q  and  8^6  0^  Since  z is  a 
complex  Gaussian  random  vector,  the  likelihood  ratio  is  written  as 
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where 


U TqJFTT  expC-(z-"L1(i1)  Qi1(£1Hz-2i(i1)3p(i1)<ie1 

Un  TO^JT  e5*C“  >\  1(^0  > (2- V V ]p(£<)  )d^0 

U *t) 


(3.22) 


"j/V  = EUje^jy  ; m^(0^)  = ECzI^.Hq} 


and  p(£^)  and  p(£q)  are  a priori  probability  density  functions. 


As  a specific  example , A(z_)  for  the  problem  of  detecting  a signal  known 
exactly  in  bandlimited  white  Gaussian  noise  is  easily  written.  Since  there 
are  no  uncertain  parameters  under  either  hypothesis  and  (3.22) 


becomes 


A(z)  = exp[-m*£_1m  + 2 Re { z* ST^m.} 3 


(3.23) 


where 


m = m ^ 


2=£i  = Qo 


and  "Re"  denotes  the  real  part. 

Recall  that  the  performance  of  this  processor  is  completely  specified 
by  the  detectability  index  d2  (see  (2.22))  which  has  the  value 


d2  = 2 m*Q-1m 


(3.24) 


Note  that  under  the  condition  in  (3.4),  the  covariance  between  any 
two  Fourier  coefficients  at  different  frequency  indices  will  be  zero.  Thus, 
the  covariance  matrix  Q will  be  block  diagonal  (KxK  blocks)  and  its  inverse 
also  will  be  block  diagonal.  The  expression  in  (3.23)  can  be  rewritten  as 


N N 

A(^)  = exp[-  l m(n)*Q  (n)m(n)  + 2 Re{  J z(n)‘fQ  InWn)}] 
n=0  n=0 


where 


= TT  exp[-m(n)*Q  ^(nJmCn)  + 2 Re{£(n)*Q  in)m(n)}] 

n=0 

m(n)  = E{£(n)|H^}  (z^Cn)  as  in  (3.14)) 


(3.25) 


Q(n)  = E{[z(n)-m(n)][£(n)-m(n)]  Ih^). 


The  likelihood  ratio  has  been  broken  into  its  "single  frequency" 
components.  This  is  the  reason  for  arranging  the  Fourier  coefficients  in 
the  observation  vector  £ as  shown  in  (3.15)  and  such  a decomposition  will 
be  valid  for  all  problems  where  the  condition  in  (3.4)  has  been  met. 

Table  3.1  summarizes  the  likelihood  ratio  expressions  for  three  realiza- 
tions of  the  array  processor  structure:  (1)  one  shot,  (2)  pseudo  estimator, 

and  (3)  two  step.  Figures  3.1,  3.2,  and  3.3  illustrate  their  corresponding 
block  diagrams.  Discussion  of  the  sequential  structure  is  postponed  until 
suitable  conditions  on  the  length  of  the  incremental  observation  interval 
have  been  established  so  that  both  the  expression  in  (3.4)  still  may  be 
considered  valid  and  parameter  conditional  independence  between  successive 
observation  increments  is  assured. 

The  fundamental  form  of  the  likelihood  ratio  is  found  in  the  one  shot 
optimal  array  processor  given  in  Table  3.1  A and  illustrated  in  Figure  3.1. 
In  this  structure,  all  of  the  data  is  processed  at  the  same  time  and  the 
likelihood  ratio  is  obtained  directly.  Once  the  mathematics  of  the  likeli- 
hood ratio  has  been  written,  however,  any  realization  of  A(£)  will  achieve 
the  same  performance.  As  mentioned  in  Chapter  II,  structuring  the  optimal 
processor  in  various  ways  often  can  be  advantageous  from  the  standpoint  of 
any  potential  insight  gaini  , comparisons  with  non-Bayesian  approaches  to  a 
similar  problem,  or  the  desire  of  greater  feasibility  and  flexibility  of 
implementation. 
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The  pseudo  estimator  structure  given  in  Tabie  3.1  B and  illustrated  in 
figure  3.2  provides  a means  of  comparing  the  optimal  array  processor  with  a 
popular  ad  hoc  detector  structure.  An  appealing  approach  to  an  array 
detection  problem  where  uncertain  parameters  .wist  is  to  es'  • these 
parameters  and  then  plug  them  into  the  conditional  likelihood  ratio  as  if 
they  were  known  exactly.  When  ''good"  estimators  are  used,  such  a structure 
as  illustrated  in  figure  3.4  appears  to  be  operating  in  an  optimal  fashion. 

p essors  of  Bryn  (Bryn,  1962)  or  Mermoz  (Mermoz,  1964;  Horton,  1969) 
typically  are  assn**  as  implementations  of  the  conditional  likelihood  ratio 
Examples  of  such  an  approach  are  the  papers  by  Chang  and  Tuteur  (Chang  and 
uteur,  1971)  for  the  detection  of  a Gaussian  signal  of  known  direction  in  a 
an  noise  field  of  unknown  statistics  and  Bienvenu  and  Vernet  (Bienvenu 
and  Vernet,  1972)  discussing  a similar  problem  where  the  signal  is  of  known 
form  instead  of  Gaussian.  Another  example  is  the  paper  by  Giraudon 
(Giraudon,  1972)  for  the  detection  of  a kno™  form  signal  of  known  direction 
imbedded  in  a non-stationary  noise  field.  It  is  not  clear,  however,  that 
piecing  together  locally  optimal  technics  -good.,  estimators  and  a 

solution  optimal  when  all  parameters  are  known)  will  yield  global  optimality 
When  the  overall  goal  is  good  detection  performance.  Note  hat  the  struc- 
tures in  Figures  3.2  and  3.4  are  equivalent  only  when  ^ . e*  and  ^ = 8* 
are  the  pseudo  estimates  of  ^ and  V Hecalling  from  (2.7)!  utilUing^he 
pseudo  estimates  results  in  the  lower  branch  of  figure  3.2  equaling  unity. 
Thus,  the  optimal  array  processor  can  be  realized  in  an  estimate  and  plug 

structure.  It  should  be  noted  that  the  pseudo  estimate  is  generally  not 
equal  to  a well  known  estimate. 
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The  third  realization  of  the  likelihood  ratio  as  a two  step  processor 
is  given  in  Table  3.1  C and  illustrated  in  Figure  3.3.  The  usefulness  of  jj 

this  structure  is  that  potentially  a major  portion  of  the  optimal  array 

- t 

i i 

processor  can  be  designed  without  knowing  the  exact  a priori  knowledge.  (J 

Thus,  a certain  degree  of  implementation  flexibility  is  achieved.  The  two  - 

step  approach  provides  the  basis  for  the  general  time  sequential  array 
processor  structure  discussed  in  Chapter  V.  ! 
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Summary  of  Array  Processor  Structures 


A.  One  Shot 


A(z) 


^91  Uteri'  c^[-(i-!l1(i1))*0‘1(81i(z-m1(91))]p(ii)d61 
-- 


®o  WT  expC‘t-2'so(^)>V%)(5.-So(«o»fe(80Me0 


where 


Si(V  = ; H^c^)  « E{£|e0,H0} 

' P<-1>  and  apc  a priori  probability  density  functions. 


B.  Pseudo  Estimator 


p<81)p(9()l2,H0) 

~ = A(zl°rV 


-here  Afz^)  = JgpV1 

and  P(®oli.H0)  and  pCe^Jz,!^)  are  a posteriori  probability  density  functions. 


C . Two  Step 


where 


and 


Jq  r(VP’(£-l;*?)d£i 
A(z>  = A’(z)  —k ___ 

'o0 

p(V  = r(i1)p,(£1ir°) 

p<V  = r(Vp,(Vi£> 

P’^lJ)  and  are  the  natural  conjugate 

a priori  probability  density  functions  used  in  forming 
A*(z). 


Table  3.1 


, .,^rv  ^tt*.mti*j<.  *»>*  -* 


arising  from  adjacent  observation  periods  would  be  desirable  since  it  can 
lead  to  a convenient  implementation  of  the  sequential  array  processor  via 
(2.3),  (2.9),  and  (2.10).  Recall  that  when  the  observables  are  jointly 
Gaussian,  zero  covariance  implies  independence.  In  this  chapter,  equations 
will  be  derived  which  express  the  covariance  between  the  Fourier  coefficients 
explicitly  as  a function  of  observation  period  length. 


Covariance  Arising  From  a Scalar  Random  Process 

Let  z(t)  be  a sample  function  from  the  zero  mean  stationary  random 
process  observed  at  the  output  of  a single  array  element.  The  Fourier 
coefficients  for  this  time  waveform  will  be  as  defined  in  Chapter  III 


! 1/2  T/2 

z(n)  = (tjt)  / z(t )exp(- jnu  t )dt 

1 -T/2  U 


(4.1) 


where 


U0  = “• 


The  expression  in  (3.4)  indicates  that  the  Fourier  coefficients  at  different 
frequency  indicies  become  uncorrelated  as  the  observation  interval  T 
increases.  Unfortunately,  little  in  insight  is  gained  as  to  how  fa»t  this 
occurs.  The  derivation  in  Appendix  A due  to  Blachman  is  most  beneficial 
to  this  respect  (Blachman,  1957).  Summarizing  those  results 


E[z(n)z(m)*]  = / N(xu)Q)sinc(x-n)sin(x-m)dx  (4.2) 


where  N(xcOq)  = the  power  spectral  density  function  of  tht  random  process 


and  sinc(x)  = 


sin (ax) 


n 


* 1 
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Note  the  orthonormal  property  of  sinc(x) 

00 

/ sinc(x-n)sinc(x-m)  dx  = 6 


nm 


(4.3) 


where 


nm 


J 1,  n^m 

j 0,  n#n 


The  variance  and  covariance  of  the  Fourier  coefficients  now  easily  can  be 
pictured  as  areas  under  a curve.  The  integrand  in  (4.2)  is  illustrated 
graphically  in  Figure  4.1  for  two  specific  cases  of  the  following  expres- 
sions 


(1)  Variance 


ECz(n)z(n)*]  = / N(xw0)sinc2(x-n)  dx 


(4.4) 


(2)  Covariance 

00 

& r 

ECz(n)z(m)  ] = / N(xu)0)sinc(x-n)sinc(x-m)  dx  . (4.5) 

— 00 

Two  conclusions  may  be  drawn 
(1)  Variance 

As  long  as  N(xu)Q)  is  approximately  constant  within  2wQ  or  3(oQ 
either  side  of  nuig,  then 


E[z(n)z(n)  ] = N(na)Q)  . 


(4.6) 


(2)  Covariance 


As  long  as  N(xwQ)  is  approximately  constant  over  the  interval 
where  the  product  sinc(x-n)‘sinc(x-m)  has  appreciable  value,  then 


E[z(n)z(m)  ] - 0 , n#n. 


(4.7) 
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Essentially,  increasing  the  observation  interval  leads  to  a smoothing  of 
the  power  spectral  density  function  when  it  is  written  as  a function  of 
xuQ  (as  T -*•  ®,  Wq  = 2ir/T  0).  Thus,  for  a given  random  process,  (4.6) 
and  (4.7)  may  be  considered  valid  if  the  observation  interval  is  chosen 
long  enough  so  that  the  power  spectrum  N(xo>q)  is  relatively  smooth  with 
respect  to  increments  in  u)Q. 

A particular  power  spectrum  often  assumed  is  that  of  bandlimited  white 
Gaussian  noise 

{No/2  , | oi  | < 2ffW 

(4.8) 

0 , otherwise 

where  W is  the  bandwidth  in  Hertz.  It  is  interesting  to  observe  how  the 
elements  of  the  covariance  matrix  associated  with  such  a spectrum  change  as 
T is  allowed  to  increase.  Appendix  B contains  a set  of  five  such  matricies 
which  represent  successive  doubling  of  the  observation  length  (Marshall, 
1973).  The  first  matrix  is  for  an  observation  length  such  that  W = .5mQ/2Tf 
or  T = . 5/W;  the  last  matrix  is  for  an  observation  length  such  that 
W = 8o>0/2tt  or  T = 8/W.  As  T increases,  the  matricies  become  progressively 
more  diagonal  in  form.  Roughly,  a condition  on  the  observation  length  can 
be  established  on  the  basis  of  the  last  matrix.  With  reference  to  the  unit 
height  spectrum,  for  at  least  80%  of  the  Fourier  coefficients  (°  <_  n N) 
to  have  the  following  properties 


(1)  .95  < E[z(n)z(n)*] 

(2)  |E[z(n)z(m)*]|  < .02 


(4.9) 


then  2WT  > 16.  Note  that  this  is  on  the  order  of  the  usually  assumed  con- 
dition arising  in  the  uniformly  spaced  time  samples  approach  to  random 
process  representation  (i.e.,  2VT  >>  1). 
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Covariance  Arising  From  a Vector  Random  Process 

The  previous  section  dealt  only  with  the  covariance  between  Fourier 
coefficients  representing  the  time  waveform  observed  at  a single  element. 
Presumably,  the  observation  length  will  be  chosen  so  that  (4.6)  and  (4.7) 
may  be  assumed  valid.  Now,  let  z(t)  be  a vector  of  sample  functions  from 
the  zero  mean  stationary  vector  random  process  observed  as  the  collection 
of  outputs  from  all  the  array  elements.  The  Fourier  coefficients  for  these 
time  waveforms  will  be  defined  as  in  Chapter  III 


,i  ,T/2 


where 


and 


zk(n)  = (j^)  / zk(t)exp(-jnw0t)  dt 


2rr 


(4.10) 


W0  " T 


k = the  array  element  index. 


Since  the  relationship  between  the  coefficients  representing  a single 
element's  output  has  already  been  discussed,  it  remains  to  consider  pairs 
of  Fourier  coefficients  arising  from  two  different  elements. 

Clearly,  if  the  random  processes  observed  at  all  the  array  elements 
are  independent  of  one  another,  their  respective  collections  of  Fourier 
coefficients  also  will  be  independent.  Such  will  be  the  case  when  we 
consider  independent  sensor  noise  in  the  problem  formulations  of  Chapter  VI. 
A different  situation  arises  when  the  noise  field  contains  an  additive 
directional  noise  component.  Now,  a portion  of  the  random  process  observed 
at  one  element  simply  will  be  a time  delayed  version  of  that  observed  at 
another.  Given  that  the  observation  length  has  been  chosen  long  enough 
so  that  (4.6)  and  (4.7)  may  be  assumed  valid,  then  any  two  Fourier 
coefficients  at  different  frequency  indicies  will  be  approximately 
uncorrelated.  However,  coefficients  at  the  same  frequency  index  will  be 
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related  as  shown  in  Appendix  C.  Summarizing  those  results 

oo 

2 


* 01- 

E[zJl(n)zk(n)*iT^]  = exp[-jnw0T£k3*/  D(xwQ)sinc  (x-n)exp[-j(x-n)(- “Y")2lr3dx 

—00 

(4.11) 

where  is  the  time  delay  between  the  and  k**1  elements  of  the  direc- 
tional noise  component  d(t)  and  D(xojq)  is  its  power  spectral  density 
function.  Note  that  if  the  reception  situation  is  such  that  plane  waves 
are  incident  across  a uniformly  spaced  linear  array,  then  x^k  = (k-Ox^ 
where  xr  is  the  time  delay  of  d(t)  between  adjacent  elements.  As  before, 
the  covariance  of  the  Fourier  coefficients  can  be  pictured  as  the  area 
under  a curve.  The  real  part  of  the  integrand  in  (4.11)  is  illustrated 
graphically  in  Figure  4.2  for  the  case  x^/T  = 1/4.  Two  conclusions  may 
be  drawn 

(1)  As  long  as  D(xu)q)  is  approximately  constant  within  2wQ  or  3u)q 

A 


either  side  of  nu)Q,  then 


E[zJl(n)zk(n)ft|Tilk3  « expMnw^)  • D(n«0)  • ( ->  > 


(4.12) 

(2)  As  long  as  D(xojq)  is  approximately  constant  over  the  interval 
where  the  product  sinc(x-n)*sinc(x-m)  has  appreciable  value, 
then 

E[zA(n)zk(m)*!r^,3  = 0 , n i m.  (4.13) 

Thus,  for  a given  additive  directional  noise  component,  (4.12)  and  (4.13) 
may  be  considered  valid  if  the  observation  interval  is  chosen  long  enough 
so  that  the  power  spectrum  D(xoJq)  is  relatively  smooth  with  respect  to 
increments  in 


T 


Covariance  Between  Adjacent  Observation  Vector's 

When  the  total  observation  period  is  broken  into  several  smaller  incre- 
mental periods  each  of  length  T,  a sequence  of  observation  vectors  will  re- 
sult. The  real  random  processes  observed  at  the  output  of  each  array  element 
will  be  assumed  zero  mean  and  stationary.  Assuming  T is  chosen  long  enough 
so  that  (4.6)  and  (4.7)  may  be  considered  valid,  then  two  Fourier  coeffi- 
cients at  different  frequency  indicies  and  in  adjacent  observation  vectors 
will  be  approximately  uncorrelated.  Coefficients  at  the  same  frequency 
index  are  related  as  discussed  in  Appendix  D.  Summarizing  those  results 
for  the  case  of  independent  sensor  noise 


E[z^(n)z^+1(n)*]  = / N(xujQ)sinc^(x-n)exp[-j  (x-n)2Tr]  dx  (4.14) 


A XtX 

where  z and  £ are  adjacent  observation  vectors  and  N(xu)Q)  is  the  power 
spectral  density  function  of  the  independent  noise.  And,  for  an  additive 
directional  noise  component 

E[z£(n)z£+  (n) ‘|T0V]=exp[~jna>ftTflVl)  / D(xwn)sinc2(x-n)exp[-j  (x-n)(l-  ~^-)2ir]dx 


(4.15) 


where  D(xeu0)  is  the  power  spectral  density  function  of  the  directional 
noise.  Two  conclusions  may  be  drawn 

(1)  As  long  as  N(xcu0)  is  approximately  constant  within  2u)Q  or  3u>Q 


either  side  of  nw^,  then  for  independent  noise 
E[z^(n)z^+1(n)*]  = 0 . 


(4.16) 


(2)  As  long  as  D(xwQ)  is  approximately  constant  within  2o>0  or  3wQ 

either  side  of  najQ,  then  for  an  additive  direction  noise  component 


E[z^(n)z^+1(n)"|Tjlk]  = exp(-jnwQT4k)  * D(nuo)  * (~7oi  2~ 


(4.17) 
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Thus,  (4.16)  and  (4.17)  may  be  considered  valid  if  the  incremental  observa- 
tion length  T is  chosen  long  enough  so  that  the  power  spectra  N(xu)q)  and 
D(xWq)  are  relatively  smooth  with  respect  to  increments  in  u^,.  Under  these 
conditions  plus  the  additional  requirement  that  <<  T,  Fourier  coeffi- 
cients within  adjacent  observation  vectors  will  have  a parameter  conditional 
covariance  of  approximately  zero. 

The  covariance  expressions  discussed  in  this  chapter  are  sumnarized 
in  Table  4.1.  Both  the  exact  expressions  and  those  conditioned  on  a 
sufficiently  long  incremental  observation  length  are  given. 


Covariance  Between  the  Fourier  Coefficients 


Let  zk(t)  = n^t)  + dQ(t  - Tok) 


where  z^Ct)  = output  observed  at  the  k element 

n^(t ) = independent  noise  component  at  the  k element 

dg(t)  = directional  noise  component  at  the  element 

T^k  = time  delay  of  directional  component  between  the  and 
k elements. 


A.  Covariance  Within  a Single  Observation  Vector  z1 
E[z*(n)zk(m)*|-rJlk] 


r 

=exp[-jnto0T£k]*/[N(xo)0)*6Jlk+D(xa)0)]sinc(x-n)sincCx-m)exp[-j(x-m)(-Y“)2Tr]  dx 


where  6„ 


1 , i=k 
ik  ] 0 , Jtfk 


N(xa)Q)  = power  spectral  density  function  of  the  independent  noise 
component 

D(xu)q)  = power  spectral  density  function  of  the  directional  noise 
component . 

B.  Covariance  Between  Adjacent  Observation  Vectors  £ and  z_ 

E[z*(n)z£+1(m)*|TWcJ 

00 

=expC-  jma»0(T-xAk ) ]♦  / CN(x(j)q  )•  d^+DCxajg  ) ]sinc(x-n  )sinc(x-m) 


expC-j  (x-m)(l =^-)2iO  dx  . 


Table  4.1 
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Now,  assume  that  the  incremental  observation  period  is  chosen  long  enough 
so  that  the  power  spectra  N(xu>0>  and  D(xWq)  are  relatively  smooth  with 
respect  to  increments  in 

• 

C.  Covariance  Within  a Single  Observation  Vector  z_ 

E[zJ(n )z*(m)*j  Tjtk3*exp[- jmM0TAk3 • CN(najQ ) ♦ 5£k+D(mo0 )3 * {- 


D.  Covariance  Between  Adjacent  Observation  Vectors  z1  and  z 


i+1 


ECz^(n)z^+1(m)*|TJlk]aC-jmu0(T-tik)3*[0+D(nuj0)]* 


Table  4.1  (continued) 


Chapter  V 

TIME  SEQUENTIAL  ARRAY  PROCESSORS 


The  general  design  equations  for  sequential  data  processing  were  given 
in  (2.8),  (2.9)  and  (2.10).  No  specific  restrictions  were  made  on  the 
nature  of  the  observation  vector  (i.e.,  Rv  could  be  a collection  of  uni- 
formly  spaced  time  samples  of  an  ongoing  waveform  or  perhaps  the  Fourier 
coefficients  of  a fixed  length  signal).  When  the  R.  are  uniformly  spaced 
time  samples,  sequential  processing  leads  to  a natural  learning  feature 
with  time  as  more  observations  are  processed.  The  frequency  domain  analog 
for  a fixed  length  signal  exhibits  learning,  not  in  time,  but  in  frequency 
sequence.  The  thrust  of  this  chapter  will  be  to  propose  a model  of  waveform 
representation  which  breaks  the  total  observation  length  into  a sequence  of 
fixed  length  incremental  observation  intervals  and  then  to  analyze  the 
consequences  in  terms  of  time  sequential  processing  utilizing  Fourier 
coefficients . 


Time  Sequential  Structure 

Consider  the  vector  of  stationary  random  processes  zit)  as  in  (3.12) 

which  is  the  vector  of  observed  outputs  from  each  array  element.  Based 

on  some  criterion  (as  yet  unchosen),  pick  an  incremental  observation 

period  and  break  z(t)  into  time  sequences  of  length  T.  . The  corresponding 

vector  of  Fourier  coefficients  representing  the  i**1  period  will  be  z 1 

as  in  (3.15).  Thus,  for  a to cal  observation  length  of  T = L*T.  , zCt) 

me  — 

wi 11  be  represented  by  L vectors  of  Fourier  coefficients,  (z^,...,z^). 


^ 1 «r=i  jtggvgg; 
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In  the  formation  of  the  likelihood  ratio,  the  marginal  distribution  of 


the  observables  conditional  to  each  hypothesis  is  needed.  Our  observables 


are  now  the  L vectors  ( _z^ , , ) . Suspending  the  conditioning  to  and 


pCz1,. . . ,zL)  = ]~f"  p(£i|£i_1,.  • • ,£1) 
i=l 

L 


r L TT  p(zi|z1-1,...,zx,6>p(8)d0 
0i=l  - 


(5.1) 


Assuming  parameter  conditional  independence  of  the  z1 


pCz^jz*  \...,£*0)  = p^i^)  . 


(5.2) 


Substituting  (5.2)  into  (5.1) 


p(£,. . . ,z_)  = / IT  p(z1|£)p(e^)dG^ 
° .i=l 


(5.3) 


Lastly,  applying  Bayes’  rule  L times  to  the  integrand  in  (5.3) 

L 


pU1,. . . ,z_L)  = Jf  J0  P(z1|£)p(e.|£1_1, . . • jZ'Sd^  (5.4) 

i=l 


where  p(£(z_1  \...,z^)  is  the  updated  version  of  the  a priori  probability 
density  function  of  0 


ptelz1-1,...,*1)  = M£'1|e)p(e|£1~2,..  .z1) 

, i-1,  i-2  1. 

P(£  |z  , . . . ,z  ) 


(5.5) 


Sequential  processing  in  time  as  summarized  in  (5.4)  and  (5.5)  now  can  be 
accomplished  using  observables  taken  in  the  frequency  domain  to  form  the 
marginal  distributions  required  to  calculate  the  likelihood  ratio 


. , 1 L. 
A(z  ,. . . ,z  ) = 


pU1,. . . ,zl|h1) 


p(z\. . . ,zb|K0) 


(5.6) 


. 7 rr-+:  ■-  ~l~*  f 
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Figure  5.1  illustrates  the  corresponding  array  processor  structure. 
Note  that  at  the  end  of  each  incremental  observation  period,  the  prior 
knowledge  for  that  period  is  updated  under  and  to  reflect  the  pro- 
cessing of  an  additional  increment  of  data.  These  updated  densities  then 
are  used  as  prior  knowledge  for  the  next  incremental  observation  period. 

The  essential  advantages  of  structuring  frequency  domain  array 
processors  in  a time  sequential  fashion  are 

(1)  No  need  to  specify  £ priori  the  total  observation  length. 

Normally,  the  number  and  location  of  frequency  samples  is 

dependent  on  the  total  observation  length  through  u0  = 2n/T. 

Operating  sequentially,  we  fix  the  incremental  observation 

period  T.  and  thereby  fix  a.  = 2tt/T.  for  any  T = L*T.  , 

F me  J 0 me  J me 

L an  integer.  Thus,  the  processor  structure  remains  fixed 
for  any  total  observation  length. 

(2)  Elimination  of  a linearly  growing  memory  requirement.  As 
mentioned  in  (1),  the  number  and  location  of  frequency  samples 
is  dependent  on  T for  the  one  shot  processor.  When  T doubles, 
the  number  of  frequency  samples  collected  for  a given  band- 
limited  observed  random  process  doubles,  etc.  Thus,  twice 

as  many  Fourier  coefficients  must  be  remembered  and  manipulated 
to  calculate  the  likelihood  ratio.  The  sequential  structure 
eliminates  this  difficulty  by  permitting  the  processing  of 
(1/L)  the  total  number  of  Fourier  coefficients  at  the  end 
of  each  incremental  observation  period. 

(3)  The  learning  or  adaptive  features  in  time  which  take  place 
naturally  with  a time  sequential  Bayesian  processor. 
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Single  Frequency /Con jugate  Prior  Decomposition 

Mow,  make  the  additional  assumption  of  parameter  conditional  indepen- 
dence between  Fourier  coefficients  at  different  frequency  indicies  and  within 
the  same  observation  vector 

p(z^(0),. . . ,z*(N) |6_)  = p(z^(0) |£). . .p(z*(N) |e_)  . (5.7) 

The  resulting  separation  of  the  joint  probability  density  function  of  the 
observables  in  frequency  modifies  (5.3)  to  become 


U 


P(z1(o)|e)..,p(z1(N)je) 


pCz^e) 

1st  observation  period 


p(zL(O)|0)...p(zL(N)|0) 


p(i)  d£ 


.th 


p(zL|0.) 


L observation  period 


= 1 


p(z1(0)|e)...p(zL<0)|9)  ...  p(z1(N)|£)...p(zL(N)|e> 


frequency 


p(£)  d£ 


(5.8) 


irh 

N frequency 


where  p(z1(n)|f>)  is  the  conditional  density  of  the  n frequency  component 
of  the  i**1  observation  vector  as  in  (3.14). 

Assume  that  ^Ix  the  conditional  densities  in  (5.8)  admit  sufficient 
statistics  of  finite  dimension  for  0 (see  Theorem  2.1,  Chapter  II).  Let 


p(£)  = r0(.i)p0(£) 


(5.9) 


where  pQ(£)  is  a natural  conjugate  prior  under  p(z1(0)|£)  and  rQ(£)  is  as 
in  (2.16).  Then,  utilizing  Bayes'  rule 


p(z1(O)|0)...p(zL(O)|e.) 


p(8) 


p(z1(0) |£). . .p(zL(0)  |e_) 


r0(i) 


= p(z1(0),. . . ,zL(O)-,po(0_))p(6_|z1(O),.. . ,zL(O);pQ(0_))  rQ(£) 


(5.10) 


1 L 

where  p(z^  (0),...,z_  (0);p q(£))  is  the  marginal  distribution  of 
(z^(0 ) , . . . ,z^ ( 0 ) ) and  p(£|z.L(0).,. . . ,£L(0);pQ(£))  is  the  a posteriori 
distribution  of  0_  based  on  a prior  of  p ^(0).  Next,  let 

p(0|z1(O),...,zL(O);po{e^))  = r1(e.)p1(0.)  (5.11) 

where  p^(0_)  is  a natural  conjugate  prior  under  p(_z1(l) 1 0.)  and  r^(£)  is  as 
in  (2.16).  Continuing  the  alternate  application  of  Bayes’  rule  and  the 
incorporation  of  natural  conjugate  priors  for  each  of  the  N+l  frequencies, 
(5.8)  becomes 

p(z\. . . ,zL)  = p (z1  ( 0 ) , . . . ,^L(0);p0(£)). . .pU^N),. . . »z.L(N);pN(9.)) 

• /@  r-o(0^). . .rN(£)p(0_|z1(N),. . . ,zL(N);pN(£))d£ 


{Jl  p(£1(n),. . . ,^L(n);p  (0))} 
n=0 


N 1 T 

* /©  {TT  rn(£)}p(£|z  (N),...,z  (N);pN(0_))d£.  (5.12) 


The  notation 


p(£|z1(n),. . . ,zL(n);pn(£))  = rn+1(£)pn+1(£) 


(5.13) 


has  been  used  to  indicate  the  relationship  between  the  a posteriori  pdf 
of  £ after  (^(n),...  ,z^(n))  has  been  processed  and  the  a priori  pdf  of 
£ used  for  processing  (z^tn+l) , . . . ,£^(n+l)).  Essentially,  the  data 
dependency  has  been  concentrated  in  rn+-^(£)  thus  allowing  freedom  in 
the  choice  of  Pn+^(£).  Figure  5.2  illustrates  the  general  array  pro- 
cessor structure  implied  by  (5.12).  The  single  frequency  sequential/conju- 
gate blocks  are  the  realizations  of  p(£^(n),. . . ,z^(n) ,p^(£) ) ; n = 0,...,N. 
Each  is  an  independent  time  sequential  processor  similar  to  Figure  5.1 
for  a single  frequency  index  using  its  own  natural  conjugate  prior.  Only 


General  Time  Sequential  Array  Processor 


the  n**1  Fourier  coefficient  from  each  array  element  is  utilized  by  the  n^ 
block.  The  integral  provides  the  correct  matching  between  the  outputs  of 
the  N+l  blocks  and  the  actual  a priori  knowledge  contained  in  r^C^)  to 
yield  the  desired  marginal  density  of  all  the  observables.  Note  the 
particular  form  of  this  integral  when  uniform  priors  are  admissible  (and 
so  chosen)  for  the  natural  conjugate  priors  Pq(9.) > • • • >PN(6_) 

N . . 

!q  {U  r (£))  P(!lz  (N).---.S.  (N);P N(0))d0 

n=C 

N 

= c /g  p< 0_) (TT  p(£|z.  (n),...,:5  (n);pn(£)}d£  (5.14) 


where  C is  a constant.  The  integral  becomes  simply  a weighting  of  all  the 
a posteriori  single  frequency/con jugate  densities  by  the  true  £ priori 
knowledge.  To  form  the  likelihood  ratio,  the  marginal  density  of  the 
observables  conditional  to  is  divided  by  the  marginal  density  of  the 
observables  conditional  to  HQ  as  in  (5.6). 

The  decomposition  s ggested  by  (5.12)  is  advantageous  for  the  following 


reasons 


(1)  Conceptually,  the  general  array  processor  is  seen  to  separate 
into  a few  well  defined  components.  In  addition,  since  all 
the  sequential/conjugate  blocks  are  mathematically  similar, 
only  the  n^  frequency  block  must  be  derived  in  detail. 

(2)  Practically,  a majority  of  the  general  array  processor  can 
be  designed  without  knowing  the  actual  a_  priori  knowledge. 
Furthermore,  the  inherent  mathematical  tractability  of 
natural  conjugate  priors  may  be  beneficial  in  the  develop- 
ment of  the  single  frequency  sequential/conjugate  blocks. 
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Criterion  for  the  Selection  of  T. 

me 

Derivation  of  the  sequential  optimal  array  processors  in  this  chapter 
relied  on  the  two  assumptions  of  parameter  conditional  independence  made 
in  (5.2)  and  (5.7).  Independence  in  time  led  to  (5.3),  and  the  addition 
of  independence  in  frequency  permitted  the  decomposition  shown  in  (5.8). 
For  jointly  Gaussian  random  variables,  zero  covariance  implies  statistical 
independence.  Thus  (assuming  the  observables  have  a parameter  conditional 
expected  value  of  zero)  (5.2)  is  valid  when 


E[z^(n)z^+l(m)*|e]  = 0 


(5.15) 


and  (5.7)  is  valid  when 


E[Zj(n)z^(m)*|0]  = 0 , n#n  . 


(5.16) 


In  this  section,  sufficient  conditions  for  the  selection  of  an 
incremental  observation  period  are  stated  which  insure  the  approximate 

validity  of  (5.2)  and  (5.7)  for  a particular  class  of  problems.  In  this 
class,  the  noise  field  is  Gaussian  and  consists  of  a component  independent 
from  sensor  to  sensor  plus  an  additive  directional  component.  The  dis- 
cussion in  Chapter  IV  relates  the  covariance  properties  of  the  Fourier 
coefficients  to  observation  interval  length  for  such  a noise  field.  The 
covariance  expression  corresponding  to  (5.15)  can  be  found  in  Table  ^.1  B 
and  (5.16)  in  Table  4.1  A. 

Sufficient  conditions  for  the  selection  of  a T.  are  as  follows 

me 

(1)  The  incremental  observation  period  shall  be  chosen  long 
enough  so  that  the  noise  power  spectral  density  function 
when  written  as  a function  of  xu>Q  is  relatively  smooth  with 

respect  to  increments  in  a)n  = 2ir/T. 

0 me 
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(2)  The  incremental  observation  period  shall  be  chosen  long 

enough  so  that  the  transit  time  across  the  array  for  the 

directional  noise  wavefront  is  much  less  than  T. 

OK  me 

The  condition  in  (l)  insures  that  any  two  Fourier  coefficients  at  different 

frequency  indicies,  be  they  within  the  same  observation  vector  z1  or  within 

i i+± 

adjacent  observation  vectors  z~  and  tT  , will  have  a parameter  conditional 
covariance  of  approximately  zero 

E[zg(n)zf(m)'{ jo]  = 0 , n^m  (Table  4.1  C) 

X R 


E[z^(n)z^+1(m)*|£]  = 0 , n#n 


(Table  4.1  D) 


The  additional  condition  in  (2)  insures  that  two  Fourier  coefficients  at 
the  same  frequency  index  and  within  adjacent  observation  vectors  z1  and 
Z1*1  also  will  have  a parameter  conditional  covariance  of  approximately 


E[zi(n)zk+1<n>*'-:1  = 0 • THk  5 t0K  ” Tinc  • 

(Table  4.1  D) 

Note  that  both  conditions  (1)  and  (2)  are  necessary  to  approximate  (5.15) 
while  only  condition  (1)  is  required  to  approximate  (5.16).  Once  a T^nc 
is  chosen  which  permits  the  assumption  of  (5.2),  the  parameter  conditional 
independence  in  (5.7)  follows  automatically  when  the  noise  field  is  within 
the  particular  class  being  considered  here. 


A specialization  of  notation  occurs  in  this  Chapter.  T.  is  used  to 

me 

denote  explicitly  the  incremental  observation  period  length  while  T is 
reserved  to  denote  the  total  observation  period  length. 


Chapter  VI 

THREE  SPECIFIC  PROBLEMS  AND  THEIR  CONDITIONAL  LIKELIHOOD  RATIOS 


The  focus  of  this  chapter  will  be  on  the  derivation  of  the  likelihood 
ratio  processors  for  three  specific  problems.  In  each,  directional  uncer- 
tainty arises  in  either  the  location  of  a signal  or  noise  source.  Our 
observables  will  consist  of  the  collection  of  Fourier  coefficients  z^  repre- 
senting the  bandlimited  time  waveforms  observed  at  all  of  the  array  elements. 
The  primary  goal  here  is  to  derive  the  single  frequency  parameter  conditional 
joint  density  expressions  under  H^  and  H^.  These  are  the  fundamental 
components  required  by  all  four  of  the  optimal  array  processor  structures 
discussed  thus  far.  Also  considered  are  the  essential  features  of  the 
sequential/conjugate  blocks  indicated  in  Figure  5.2  which  evolve  out  of 
the  mathematics  of  each  problem.  Lastly,  the  incorporation  of  a conjugate 
prior  into  each  block  and  the  integral  which  results  is  discussed. 


Uncertain  Direction:  General  Formulation 

The  problems  considered  in  this  chapter  involve  either  signal  or  noise 
location  uncertainty.  As  mentioned  in  Chapter  II,  likelihood  ratio  expres- 
sions for  such  problems  were  originally  pursued  by  Adams  (Adams,  1973).  An 
array  of  K uniformly  spaced  elements  on  a straight  line  is  assumed  with  the 
zeroth  element  being  the  right-most  sensor.  The  processor  will  be  asked  to 


decide  between  the  two  mutually  exclusive  and  exhaustive  hypotheses  H^  that 
the  time  waveforms  observed  at  the  elements  consist  of  signal  plus  noise 


and  Hq  that  they  consist  of  noise  alone. 


— «w»  ww!w«r>q>ag 
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When  noise  alone  is  observed,  the  array  element  outputs  are  sample 
functions  of  zero  mean,  stationary  Gaussian  random  processes.  One  component 
of  the  noise  process  is  assumed  to  be  spatially  uncorrelated  (i.e.,  indepen- 
dent from  sensor  to  sensor).  The  power  spectral  density  function  of  this 
component  N(u)  is  assumed  to  be  the  same  at  each  element.  The  second 
component  of  the  noise  process  is  due  to  a directional  Gaussian  noise  source 
in  the  far  field  of  the  array.  The  power  spectral  density  function  of  this 
spatially  correlated  component  is  denoted  D(oj).  Both  components  are  assumed 
bandlimited.  Utilizing  the  notation  of  Chapter  III  and  choosing  an  obser- 
vation period  sufficiently  long  for  the  expression  in  Table  4.1  C to  be  as- 
sumed valid 

p(sjHo)  = 4„t  TT  '-kT— -«*!-*(»> *yn,T n)'1£(n)])p(»  t )a»  t 

0 n n=0  7r  Q (n,T  ) 

-H)  n 


* 


where 


_i  Dvv‘ 

2o(niTn)  = N L ~ n(N+K*D) 


(6.1) 

(6.2) 


N = N(na>0)  and  D = D(nu)Q) 


v(n,xn)  = Cl,  exp(  jniOgT^) ,. . . , exp(  j(K-l)nu>0Tn)]  (6.3) 


and 


<4 


2tt 


0 = -£-  , T the  observation  period  length. 


Uncertainty  in  location  is  reflected  in  the  parameter  which  is  the  time 
delay  of  the  directional  noise  between  adjacent  elements.  Our  a priori 
knowledge  on  this  parameter  is  summarized  by  the  probability  density  function 
p(o)QTn).  Since  the  covariance  matrix  is  of  the  special  form 


2g(n,Tn)  = N I + D v v 


(6.4) 


1 


E 


where  £ is  the  K-dimensional  identity  matrix  and  v(n,xn)  "pointing 


vector"  in  the  direction  of  the  noise,  its  inverse  in  (6.2)  is  given  by 


Bartlett  (Bartlett,  1951).  A detailed  discussion  of  this  result  is  given 


in  Appendix  E. 


The  signal  consists  of  a Gaussian  random  process  with  a known  time 


varying  mean.  When  signal  plus  noise  is  observed,  the  array  element  outputs 


consist  of  time  delayed  versions  of  this  signal  process  added  to  the  noise 


processes  described  above.  The  random  component  of  the  bandlimited  signal 


process  has  a power  spectral  density  function  denoted  by  S(u)  and  the 


deterministic  component  is  represented  by  the  Fourier  coefficients  b^(n) 


at  the  zeroth  array  element.  Again,  utilizing  the  notation  of  Chapter  III 


and  choosing  an  observation  period  sufficiently  long  for  the  expression  in 


Table  4.1  C to  be  assumed  valid 


p(z|H  ) = / / IT  {-? 

— 1 ■'oi-T  ' K:_  , ,i 

Os  0 n n=0  ir  Q-(n>x  ,x  ) 
—l  s n 


& -1 

• exp[-(z(n)-b  (n)u(n,T  ))  Q (n,x  x ) (z(n)-b  (n)u(n,x  )]} 

v s x s n u 1 s 


p(u0Ts’“0Tn)d610TndVs 


(6.5) 


........  „ /._  ,-l  ..-1,  D ( N+K«S ) w*+S ( N+K • D ) uu 5t- 2 • D • S RetmiV} 

»her=  Q1<n'VTn>  = K 1 HfTH+K*D j(H+K*S)-D*S  u"vv<7  (6'6) 


N = N(nwQ),  D = D(nu)Q),  and  S = S(nuQ) 


v(n,x  )"  = [1,  exp(jna)nx  ),, . . ,exp(j(K-l)nu  x )] 
n u n u n 


u(n,Ts)  = [1,  exp(jnu0xs),...  ,exp(j(K-l)noJ0xs)] 


(6.7) 


and  cd  _ = 


®0  = ~ T tne  °^servat^on  period  length. 
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Uncertainty  in  the  sigr  1 location  is  reflected  in  the  parameter  t which 

s 

is  the  time  delay  of  the  signal  between  adjacent  elements.  Under  this 
hypothesis,  the  covariance  matrix  is  of  the  form 

A A 

Q.(n,t  ,t  ) = N I + D vv  + S uu  (6.8) 

— l s n - — 


whose  inverse  in  (6.6)  also  is  discuf  ;ed  in  Appendix  E. 

The  likelihood  ratio  is  by  definition  the  ratio  of  (6.5)  and  (6.1) 


A(z)  = 


p(zjH^) 


- = PdfHjT 


(6.9) 


Three?  Problems 

The  preceding  section  provided  the  general  formulation  of  the  array 
processor  when  there  is  location  uncertainty.  Note  how  the  integrands  in 
(6.5)  and  (6.1)  separate  into  their  single  frequency  constituents.  These 
single  frequency  conditional  densities  will  be  derived  for  three  specific 
problems 

(1)  Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD), 

(2)  Signal  Known  Except  for  Direction  in  Noise  with  an  Additive 
Directional  Noise  Component  of  Known  Direction  (SKED  in  NKD), 

(3)  Signal  Known  Exactly  in  Noise  with  an  Additive  Directional 
Noise  Component  of  Uncertain  Direction  (SKE  in  NUD). 


GUD 

Under  HQ 

p(z(n)|Hn)  = — exp[-z(n)*Q,.(n)  ^(n)]  (6.10) 

* IVn)! 

where  Q.(n)  = N I (6.11) 


j 

» 

f 

i 


N = N(nto0) 


t 


Under  H, 


p(z(n)|uv.T  ,H  ) = — - exp[-z(n)*Q  (n)  1z(n)] 

’ 03  1 ZlQ^n^)!  “ -1  " 


(6.14) 


0,  (n  ,r  ) = N I + S u u 
s — 


N = N(n<ii_)  and  S = S(nwA) 
0 0 


u(n,r  )"  = [1,..,  exp(jncc  x ),. . . , exp( j (K-l)nw  x )3 
■ — s US  US 


(6.15) 


|Q1(n,xs)|  = NK  1(K-S+N) 


(6.16) 


. x-1  -1  S UH.* 

-l(n,Ts  = N - “ N(K+K*S) 


(6.17) 


Since  the  uncertain  parameter  exists  only  under  the  single  frequency 
conditional  likelihood  ratio  is  of  interest 


A(z(n)  l(1)0Ts)  = 


A P(i(n)IVS’Hl) 


iz(n) |H, 


(n)|  exp[-z^(n)"(Q1(n,Tg)  -(^(n)  )a,(n)].  (6.13) 


Making  the  appropriate  substitutions  from  (6. 10)-(6. 17)  into  (6.18) 


A(z(n)lV  > = «p[  ( ^ , I ZiM\MS 

1=0 


• exPCr?(NTK^T  2 {flL  A4cos(ln«0Ts+B4))]  (6.19) 

*»”  JL 


Kt^aaBB^^aaMsgHBBSSSKS^S  - -- 
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where 


A&  cos  B^  = Re[Cg] 


A^  sin  B^  = ImtC^] 


and 


c»  - J zi(n)*Wn)  • 
1=0 


(6.20) 


(6.21) 


The  essential  features  of  the  processor  structure  for  this  problem  are 
illustrated  in  Figure  6.1. 

SKED  in  NKD 


Under  H, 


p(z(n) |H  ) = exp[-z(n)*Q(n)_1z(n)3 

0 /|Q(n)|  - - - 


where 


and 


Q(n)  = N I + D v v 


N = N(nuQ)  and  D = D(n Wq) 


v(n)  = [1,  exp( jua^O,  ...»  exp(  j (K~l)nu>0Tn)] 

_ * 

. .-I  -1  D v v 

uv.')  1 = n xz  - 


(6.22) 


(6.2L-) 


N(N+K*D)  * 


(6.24) 


Urder  H, 


p(z(n)|u>QT  ,H  ) = — — exp[-(z(n)-bn(n)u(n,T  ))‘‘Q(n)  1(z(n)-bn(n)u(n,t  ))] 

1 *|Q(n)|  ~ 0 ~ s ~ - 0 - s 


(6.25) 


where  u(n,T  )*  = Cl,  txp(jnu  x ),  ...»  exp(  j (K-l)no)„T  )]  . 

5 US  OS 


Since  the  uncertain  parameter  exists  only  under  H^,  the  single  frequency 
conditional  likelihood  ratio  is  of  interest 


, Tn  M i mi  nilitfiitf  •iirra"r’'^  ‘ 


or 


. A P<*MmqT  ,K  ) 
A(i<n)lVs)  = p<£<n)|H0) 


• exPC2  Re{z.(i  )*<i(n)"1b0<n)u(n,Ts)}  - | b0  (n ) 1 2u(n  ,-iJ* l(n )~1u(ri,rs ) ] . 

(6.26) 

Making  the  appropriate  substitutions  from  (6. 22)- (6. 25)  int-'  (6.26) 

|y„>|2 

K— 1 

+ 2 Re(^z0(n)  bQ(n)  - ^l-D)  JQZi(n)\(n)eXp(~jinVn)}:i 

K-l 

* exp[2  l A£  cos(£nw0Ts  + B£)]  (6.27) 


where 


A cos  B = Re[G.]  - Re[Hj  + Re[IJ 


A l *--•£■*  ’ *”**•*£- 

\ sin  B£  =-Im[G£]  + ImCH^]  - Im[I£] 


(6.28) 


and 


Gz  ~ W h(n)\(n) 


K-l 


H£  = N(nVk-D)  l zi(n)*b0(n)  exp(-j(i-£)nu>0Tn) 


(6.29) 

(6.30) 


I£  “ N(N+K*D)  exp(  jAnu^O  . (S.31) 


The  essential  features  of  the  processor  structure  for  this  problem  ar 
illustrated  in  Figure  6.2. 


SKE  in  NUD 

Under  H_ 

G 

P(?Jn>!Vn,H0>  = “k r~^ expr-z(n)*Q(n?x  )"1a(n)] 

*'  Q(n,r  )l  n 

Tl 


(6.32) 


where 


and 
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£ 

G(n,x  ) = N I + D vv  (6.33) 

— n — 

N = N(nii>0)  and  D = D(na)Q) 

v(n,x^)*  = [1,  exp(jnai0Tn),  exp(  j(K-l)no)Qxn)3 


|Q(n,Tn)| 

QCn,'^)'1 


= NK_1(K‘D+N) 


* 

-l  D 

N - ~ nTn+K'D)  ' 


(6.34) 


Under 

p(z(n) |w  t ,H,)  • — v i exp[-(z(n)-brt(n)u(n))MQ(n,T  )_1(z(n)-bn(h)u(n))] 

” 0 n 1 * |2(a,t  )|  " 0 _ 

n 

= ?: exp[-z(n)*Q(n,x  ) ^z(n)+2Re{z(n)*Q(n,x  ) (n)u(n)} 

nK|Q(n,Tn)|  ~ - n 0 


- |bQ(n) |2u(n)*^(n,tH)  Au(n)3  (6.35) 

wheT  a u(n)*  = Ll,  exp(jnw  x ),  ...,  exp(  j(K-l)na)  x )]  . 

us  us 

Since  the  uncertain  parameter  exists  under  both  hypotheses,  the  conditional 
joint  densities  must  be  retained  individually.  Making  the  appropriate 
substitution:  from  (6.32)— (6.35)  into  (6.32)  and  (6.35) 


P(£(n)|u0xn,H0)  = 


V~i-D+N)eXPC~  CN(N+K-D)"3J0Zi(n)  Zj/n)>expLN(N+^D)2[iAAcos(£nu0xn+BJl)3 


(6.36) 


and 


1 


TO 
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tK-1 


p(z(n)|a)  t ,n  ) = -Y'k-l'^ exp["  ['!ivNVK^'r  £ zi(n)%^n) 

° n 1 /nK  1(K-D+N)  NCN+K  D)  i=0  1 1 

+ 2 Re*N<N+K*D)  J-Zi  exp^~^lnt°0Ts  ^ - N(N+K*D)  'b0  n^' 


K-l 


eXpCN?N^Dy  2 Aj  cos(AnW()Tn  + bJ)3 


(6.37) 


where 


cos  = Re[C^] 


(6.38) 


aJ  sin  B°  = Irrc,3 


aJ  cos  Bb  = Re[C£]  - Re[D£]  - Re[E^]  + Re[F£] 


(6.39) 


A*  sin  bJ  = IraCC^]  - Im[D£]  + ImCE^]  + ImCF^] 


and 


a K-1~l  * 

C,  = l z.(n)  z.  . (n) 

i=0  1 


(6.40) 


.K-l-£  * 

D£  - l zi(n)  b0(n)exp(-j(i+£)nu0Ts) 


(6.41) 


K-l 


E £ - I z.(n)  b0(n)exp(-j(i-£)nwQTs) 
i=fc 


(6.42) 


F^  - |bQ(n) | 2 (K-£)exp(-j£nu0Ts)  . 


(6.43) 


The  essential  features  of  processor  structure  for  this  problem  are  illus- 
trated in  Figure  6.3.  The  energy  measuring  terms  in  (6.36)  and  (6.37)  are 
not  included  since  they  will  cancel  in  the  formation  of  the  likelihood 
ratio. 

The  results  of  this  section  are  summarized  in  Table  6.1. 
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Figure  6.3.  Essential  Features  of  the  Likelihood  Ratio  for  SKE  in  NUD 
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Conjugate  Priors 

The  single  frequency  parameter  conditional  expressions  summarized  in 
Table  6.1  can  be  used  directly  in  calculating  the  likelihood  ratio  by  simply 
substituting  them  in  (6.5)  and  (6.1)  with  A(^)  given  by  the  ratio  in  (6.9). 
The  expressions  in  Table  6.1  also  are  the  fundamental  components  required 
by  the  general  array  processor  structure  implied  by  (5.12)  and  illustrated 
in  Figure  5.2.  Each  sequential/conjugate  block  is  an  independent  time 
sequential  processor  for  a single  frequency  using  its  own  natural  conjugate 
prior.  Conjugate  priors  are  used  since  they  are  reproducing  and  thus  lend 
a certain  amount  of  mathematical  tractability  to  the  problem. 

Recalling  from  Chapter  II,  the  existence  of  a sufficient  statistic 
for  £ implies  the  existence  of  a natural  conjugate  class  of  probability 
density  functions  under  p(z(n)|£).  From  Theorem  2.1,  6(z(n) ) is  sufficient 
for  0^  if  there  exists 

(1)  a function  gC$(z(n)),0]  which  depends  on  the  observation  only 
through  6( • ) , and 

(2)  a function  G(z(n))  which  does  not  depend  on  0,  such  that 


p(z(n)|jO  = g[£(z(n)),0]  G(z(n))  . 


(6.44) 


The  parameter  conditional  expressions  in  Table  6.1  suggest  the  following 
general  form  of  6 


- = fA0’B0”  *’  ,A£’E£,'“  ,AK-1’BK-1] 


(6.45) 


and  of  g[6,0] 


g[6,0]  = exp[C  £ A cos(£niu  T + B )] 
1=1  1 
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where  C is  a constant  and  r represents  xs  or  rn  depending  on  the  particular 
problem  being  considered.  Wa  see  from  Theorem  2.2  that  (6.46)  also  defines 
a reproducing  class  of  densities  under  pC z_(n ) 1 6_) . Thus,  conjugate  priors 
for  these  problems  have  th>  form 

K-l 

exp[  £ IL  cos(inunTJ-V5  )] 

&=1  

/ (numerator)  dwnT 
w t 0 

0 


P'(uj0t)  = 


(6.47) 


where 


U£  > 0 , 


< it  , and  t again  represents  ts  or  tn 


Each  sequential/conjugate  block  in  Figure  5.2  forms  a single  frequency 
marginal  density  based  on  its  particular  conjugate  prior.  The  integral 
required  to  average  over  p*(uj0t)  has  a form  similar  to  that  in  the  denomi- 
nator of  (6.47).  In  general,  this  integral  cannot  be  completed  in  closed 
form  and  some  numerical  technique  must  be  used  for  its  solution.  Note  the 
following  special  case 


1 7r 

2^-  / exp[A  cos(u>qt  + B)]dw0T  = IQ(A) 

-7T 


(6.4d) 


where  A > 0,  j B | < tt,  and  Iq(*)  is  tf-  modified  Bessel  function  of  order  zero. 
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Single  Frequency  Parameter  Conditional  Expressions 


A.  Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD) 


N s K-1 

A(z(n)|Va)  ' “pCR?iSFs7  zi(n)  2i(n):i 


S K"x 

“rffRiffiFsT  2{J,  V03Un“oVV):l 


where 


and 


A,  cos  B.  = ReCC.] 


A£  sin  B£  = ImCC^] 


a K-1~t  * 

ct  - j0  zi(n)  zi+tln) 


B.  Signal  Known  Except  for  Direction  in  Noise  with  an  Additive  Directional 
Noise  Component  of  Known  Direction  (SKED  in  NKD) 

K[N+(K-1)D] 


MzM\u0ts)  = exP[-  ~ nTnVW ' ' fbo(n)l 


K-l 


+ 2 Re{^z0(n)  b0 (n > “ n^N^K^dT. ?0Zi(n )*bQ (n >exP ( " j Xnw0Tn ^ 


K-l 


where 


and 


• exp[  2 l A.  cos(£nu)nT  + B,)] 
i=l  1 0 s 1 


At  cos  B£  = Re[G1]  - Re[H£]  + Re[I£] 


A£  sin  Bt  = -Im[G£;]  + Im[H£]  - Im[I£] 


Gt  ^ i zt(n)\(n) 


A D K_1  * 

Hl  • N(lMCD)  J„  zi(n)  b0<n)  exp(-j(i-t)nVn) 
1=0 


Table  6.1 
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Chapter  VII 

GENERALIZED  PERFORMANCE 


u 


i ' 

The  performance  of  a Bayes  optimal  processor  is  summarized  by  its  ROC  * 

curve.  In  the  general  case  where  uncertain  parameters  exist  under  each  >,  . 

hypothesis,  knowledge  about  them  is  explicitly  noted  at  the  outset  by  an 
a priori  probability  density  function  conditonal  to  and  one  conditional 
to  Hq.  The  processor's  performance  then  becomes  a function  of  their 
detailed  shape.  Often,  the  functional  form  of  these  densities  is  chosen 
so  that  various  levels  of  uncertainty  are  easily  modeled  and  a family  of 
ROC's  is  reported.  The  question  then  arises:  What  performance  would  have 

been  achieved  under  different  prior  knowledge  assumptions  (particularly 
when  outside  the  class  of  densities  modeled)?  Or,  more  deeply:  Does  some 

algorithm  exist  which  will  operate  on  a known  ROC  for  a given  pair  of  priors 
to  yield  the  ROC  for  a new  set  of  priors?  And,  if  not:  Does  a canonical 

intermediate  step  exist  between  observation  and  likelihood  ratio  statistics 
which  always  may  be  used  as  a starting  point  for  the  calculation  of  an  ROC 
based  on  an  arbitrary  pair  of  priors?  The  purpose  of  this  chapter  is  to 
pursue  these  questions.  The  discussion  will  use  as  a basis  the  fundamental 
concepts  of  sufficient  statistics  and  reproducing  densities  introduced  in 
Chapter  II. 

The  ROC  and  Observation  Statistics 

In  the  evaluation  of  performance,  both  a decision  rule  (i.e.,  likeli- 
hood ratio  plus  threshold)  and  ob  ovation  statistics  are  needed.  Consider 


s 


the  general  case  where  uncertain  parameters  exist  under  each  hypothesis. 


The  decision  rule  is  written 


A(R)  = 


/0  p(R|£1.h1>p(£1>  d^  °1 
— i < 

/eo  P<®IVBo)p(V  d$o  D° 


(7.1) 


where  R is  a vector  of  observations,  p(9_^)  and  p(6^)  are  a priori  probabil- 
ity density  functions  of  the  uncertain  parameter  vectors  8^  and 

0„£0-,  and  n is  the  decision  threshold.  The  likelihood  ratio  can  be 
— u u 

viewed  simply  as  a trans format ion  of  random  variables  from  the  observation 
space  (typically  of  large  dimension)  to  the  one  dimensional  decision  space 
Co,®).  It  is  the  conditional  distribution  of  A under  and  from  which 
the  ROC  is  calculated  (see  (2.20)  and  (2.21)).  Peterson,  Birdsall,  and 
Fox  (Peterson,  Birdsall,  and  Fox,  1954)  have  shown 


p(A|H  ) = A p(A|HQ) 


(7.2) 


Thus,  only  the  density  of  A conditional  to  HQ  need  actually  be  obtained. 

Owing  to  the  large  dimensionality  reduction  between  observation  and 
decision  spaces,  the  question  arises  as  to  what  "information"  is  lost  in 
the  mapping.  L appose  we  are  given  an  ROC  and  the  general  equation  for 
A(R)  as  in  (7.1)  for  which  it  summarizes  performance.  Now,  consider  a new 
pair  of  priors  p'^)  and  P*(9q)-  Will  the  ROC  under  p(6_1)  and  p(0g) 
provide  us  with  sufficient  information  to  calculate  the  ROC  under  the  new 
prior  knowledge?  Birdsall  has  proven  two  propositions  which  relate  to 
this  question  (Birdsall,  1973) 

(1)  An  ROC  curve  contains  insufficient  information  to  specify 

the  observation  statistics  that  led  to  it,  or  even  to  specify 
the  statistics  on  a real  decision  axis  that  led  to  it. 
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(2)  An  ROC  does  contain  sufficient  information  to  specify  the 
statistics  on  the  logarithm  of  the  likelihood  ratio. 

The  second  proposition  guarantees  that  we  can  obtain  the  densities 
pdnAlH^)  and  p(lnAjHQ)  from  just  the  information  present  on  the  ROC 
curve.  The  first  states  that  these  densities  are  insufficient  to  specify 
the  observation  statistics  leading  to  them.  A simple  example  will  illus- 
trate this  last  point. 

Consider  the  detection  of  a signal  known  exactly  in  white  Gaussian 
noise.  Recall  from  Chapter  II  that  performance  for  this  problem  is  com- 
pletely characterized  by  the  detectability  index 


where  E is  the  received  signal  energy  and  NQ/2  is  the  noise  power  spec- 
trum height.  Clearly  the  observation  statistics  pCRjH^)  and  p(R|hq)  will 

depend  on  the  exact  shape  of  the  signal  and  height  of  the  noise  power 

2 

spectrum.  Note  that  the  value  of  d depends  only  on  the  ratio  of  signal 
energy  to  spectrum  height.  Thus,  many  observation  situations  can  yield 
the  same  ROC  curve.  Correspondingly,  the  information  lost  in  the  dimen- 
sionality reduction  from  observation  space  to  decision  space  is  the 
detailed  nature  of  the  observation  statistics. 

Since  the  ROC  is  insufficient  to  specify  the  observation  statistics 
leading  to  it,  the  conditional  statistics  required  in  (7.1)  prove  to  be 
an  impossible  refinement.  Thus,  simply  being  given  an  ROC  and  the  under- 
lying priors  p(£^)  and  p(A^)  will  not  provide  enough  information  to 
calculate  performance  under  a new  pair  of  priors  p'(6^)  and  p'(0^). 
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The  Role  of  Sufficient  Statistics 

Admittedly,  attempting  to  calculate  performance  under  a new  pair  of 
priors  with  only  the  original  priors  and  their  ROC  curve  as  a basis  is  an 
ambitious  goal.  But  it  does  lead  one  through  the  visualization  of  A(R) 
as  a transformation  of  random  variables  and,  more  importantly,  that  the 
direct  mapping  from  observation  space  to  decision  space  under  A(R)  is 
"lossy." 

Consider  a new  situation.  Suppose  the  performance  of  a particular 
detection  receiver  is  desired  and  assume  there  are  uncertain  parameters 
under  each  hypothesis.  In  this  case,  the  conditional  statistics  in  (7.1) 
will  be  available  explicitly  (i.e.,  their  functional  form).  Once  again, 
view  A(R)  as  a transformation  of  random  variables.  To  compute  performance 
for  a particular  pair  of  priors  p(6^)  and  p(0^) , the  transformation  through 
A is  completed  to  yield  pCA)^)  and  p(A Jhq)  from  which  the  ROC  can  be 
determined.  Now,  if  the  performance  for  an  entirely  different  pair  of 
priors  p'(0^)  and  p*(8 ^)  is  desired,  the  transformation  must  begin  again 
with  the  observation  statistics  and  proceed  as  outlined  above.  The  ques- 
tion arises:  Is  there  some  well  defined  intermediate  step  between  the 

observation  statistics  and  those  of  A which  we  might  use  as  a basis  (i.e. , 
a new  "observation  space"  of  lower  dimensionality  than  J?)  for  the  computa- 
tion of  performance  for  any  pair  of  priors? 

The  remainder  of  the  discussion  will  assume  that  pO^iSpH^)  and  p* (RJJqjHJ 
admit  sufficient  statistics  of  finite  dimension  fox  8.  and  9-,  respectively. 
The  expression  in  (7.1)  becomes 


= i S n 

%(*>feo  «oC5o«).V  p(V  d^o  Do 


(7.3) 


m 
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where  6^(R)  and  Jig(R)  are  the  finite  dimensional  sufficient  statistics  as 
in  (2.12).  It  appears  from  (7.3)  that  a plausible  intermediate  step  would 
be  the  space  formed  by  the  random  variables  G^(R)/Gq(R),  6j(R),  and  6^(R). 
This  step  occurs  just  prior  to  the  averaging  over  p(0^)  and  p(0^)  and  is 
illustrated  in  Figure  7.1.  Recall  that  only  the  transformation  conditional 
to  Hq  need  be  carried  through  due  to  the  formula  in  (7,2).  Two  observa- 
tions can  be  made 

(1)  Uncertain  parameters  under  only. 

In  this  special  case  of  the  general  problem,  the  observation 
statistics  conditional  to  HQ  stay  the  same  when  new  prior 
knowledge  is  assumed.  Thus,  the  proposed  intermediate 
step  is  a valid  point  from  which  calculations  of  perfor- 
ance  for  any  prior  knowledge  can  be  started, 

(2)  Uncertain  parameters  under  and  HQ. 

Since  the  observation  statistics  under  HQ  essentially  have 
p(0ri)  embedded  in  them,  the  proposed  intermediate  step  will 
be  valuable  only  when  p(0^)  remains  fixed  and  p(0^)  alone 
is  allowed  to  change. 

An  Example : SKEP 

As  a specific  illustration  of  the  natural  intermediate  step  discussed 
in  the  previous  section,  consider  the  problem  of  detecting  a signal  known 
except  for  phase  (SKEP)  in  additive  white  Gaussian  noise  bandlimited  to 
W Hz.  (Roberts,  1965).  Since  there  is  a single  uncertain  parameter  and 
it  exists  under  the  hypothesis  only,  the  likelihood  ratio  can  be 


written  as 
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A(R)  = exp[-d  /2 ]/.  expEKx(R)cos<|>  + y (R^)sin<J> ) Dp(<{> )d<J>  < n (7.4) 

* r\ 


where 


,2  2E 
d ^ 


7UT 

E = I s?(t.)  = £ [m(ti)cos(uti-<f)]' 


Nq/2  = height  of  the  noise  power  spectrum 


2WT 

x(R)  = — ~ 1 1 I R(t.  )m(t.  )cos  cot. 

t . /rtmr  • ^ ^ 


W/2ENq  i=l 


1 zWl 

y(R)  = — —^3  £ R(t.  )m(t.  )sin  cot. 

tt  /nr*u  • i 11  1 


W/2ENq  i=l 


In  the  notation  of  sufficient  statistics,  (7.4)  becomes 


A(R)  - ^gCi.(R),<fr]p(<|>)d<f>  > n 

Do 


(7.5) 


where  g[6.(R),4i]  = exp[-d  /2  + d(<5  (POcos<t>  + 6 (R)sirnJ))] 


A(R)  = C5  (R),6  (R)]T  = [x(R),y(R)]T  . 


Conditional  to  HQ,  x(R)  and  y(R)  are  independent  Gaussian  random  variables 


with  zero  mean  and  unit  variance.  Thus,  the  desired  intermediate  density 


as  indicated  in  Figure  7.2  is 


P(6(Hq)  = p(x(R),y(R)|H0) 


= N(0,1)  • N(0,1) 


(7.6) 


where  N(0,1)  denotes  a Gaussian  density  with  zero  mean  and  unit  variance. 
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We  may  now  view  pCjSjH^)  as  new  "observation  statistics"  and  performance  for 
any  prior  p(<j>)  can  be  obtained  by  completing  the  indicated  transformation 
of  random  variables.  Note  that  a significant  dimensionality  reduction  has 
taken  place  without  loosing  the  ability  to  compute  performance  for  an 
arbitrary  prior. 

When  a priori  knowledge  is  chosen  from  the  class  of  densities 


exp[A  cos  ( B -<f> >3 

e(*> STT7I-) . o < * < 2« 


(7.7) 


y 

n 


‘0  0' 


= 0 


, otherwise 


Roberts  has  shown  that  the  likelihood  ratio  becomes  (Roberts,  1965) 


exp[-d2/2]  Iq(A1) 

A W 
2 2 

where  A.^^  = [d*.x(R)  + aq  cos  Bq]  + [d*y(R)  + AQ  sin 

The  processor  block  diagram  is  shown  in  Figure  7.3.  Note 

T 

statistic  6/R)  = [x(R),y(R)]  is  calculated  jusu  prior  to 
of  the  a priori  knowledge. 


(7.8) 


that  the  sufficient 
the  incorporation 


Performance:  Optimal  and  Suboptimal 

The  observations  at  the  end  of  the  second  section  pointed  out  the 
usefulness  of  the  joint  density  p(G^/Gq,^,6^|H(J)  as  an  intermediate  step 
in  the  calculation  of  performance  for  an  arbitrary  prxor.  In  general, 
this  step  will  enable  us  to  calculate  optimal  performance  only  when  p(0^) 
is  allowed  to  be  arbitrary. 

The  intermediate  step  potentially  may  be  beneficial  in  a different 
sense  when  both  p(8.)  and  pro^)  are  allowed  to  be  arbitrary.  Although 

™1  “w 

optimal  performance  cannot  be  obtained,  the  processor's  sensitivity  to 


ig_re  7.3.  SKEP  Processor.  (Roberts.  1965) 
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an  accurate  incorporation  of  £ priori  knowledge  can  be  studied.  In  this 
case,  the  intermediate  density  conditional  to  both  and  will  be  needed 

since  the  secondary  processor  they  feed  is  no  longer  optimal  (i.e.,  the 
observation  statistics  do  not  have  embedded  in  them  the  priors  utilized 
in  the  processor).  One  such  problem  of  potential  interest  would  be  where 
the  single  uncertain  parameter  of  noise  power  spectrum  height  exists  under 
H and  H . 

A major  benefit  of  a natural  intermediate  step  between  observation  space 
and  the  likelihood  ratic  is  found  in  performance  calculation  via  computer 
simulation.  When  only  the  prior  knowledge  under  is  arbitrary,  the  inter- 
mediate step  shown  in  Figure  7.1  is  a valid  point  from  which  performance 
calculations  can  begin.  As  in  the  SKEP  problem,  this  step  can  represent 
a significant  reduction  in  dimensionality  from  that  of  the  observation  space. 
The  procedure  would  be  to  generate  observation  vectors  R conditional  to  HQ. 
For  each  R,  the  values  of  G^/GQ,  6^,  and  6^  would  be  calculated  and 
retained  (in  effect,  generating  a discrete  version  of  p(G  /G  ,6,  ,6JH  )). 
Then,  for  every  p(0^)  of  interest,  the  new  "observation  vectors"  consisting 
of  (G^/Gq,^,^)  would  be  used  as  input  to  the  secondary  pr.xiessor  shown 
in  Figure  7.1.  The  resulting  collection  of  A's  would  be  used  to  form  an 
approximation  to  p( A J HQ ) and  performance  calculated. 
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Chapter  VIII 

THREE  SPECIFIC  PROBLEMS  AND  THEIR  PERFORMANCE 


Detection  performance  in  terms  of  the  receiver  operating  characteristic 
(ROC)  curve  for  the  following  three  specific  problems  now  will  be  discussed 

(1)  Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD) 

(2)  Signal  Known  Except  for  Direction  in  Noise  with  an  Additive 
Directional  Noise  Component  of  Known  Direction  (SKED  in  NKD) 

(3)  Signal  Known  Exactly  in  Noise  with  an  Additive  Directional 
Noise  Component  of  Uncertain  Direction  (SKE  in  NUD). 

Their  parameter  conditional  joint  density  expressions  were  derived  in 
Chapter  VI  and  summarized  in  Table  6.1.  To  evaluate  performance,  the 
three  optimal  array  processors  were  implemented  on  the  computer.  Fr  u 
Monte  Carlo  simulations  of  each  processor,  the  distribution  of  A(z)  under 
Hq  was  obtained.  This  distribution  then  was  used  to  calculate  the  detec- 
tion and  false  alarm  probabilities  which  are  summarized  on  the  ROC  curve. 
Several  important  concepts  in  the  calculation  of  performance  for  likelihood 
ratio  processors  via  computer  simmulation  are  discussed  in  Appendix  F. 

Prior  Knowledge 

In  each  of  the  three  problems,  uncertainty  arises  in  the  location  of  a 
signal  or  noise  source.  The  array  processor  sees  location  uncertainty 
reflected  in  terms  of  an  uncertain  time  delay  of  the  directional  source 
between  adjacent  elements.  And,  in  turn,  this  corresponds  to  an  uncertain 
phase  delay  in  the  frequency  domain  where  the  processing  is  actually  carried 
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out.  Thus,  a priori  knowledge  on  location  will  be  summarized  by  the  prob- 
ability density  function  p(uSqT)  where  t represents  either  Tg  or  t , Such 
knowledge  is  explicitly  incorporated  into  the  likelihood  ratio  processor 
through  the  averaging  in  (6.1)  and  (6.5). 

The  density  p(a>QT)  was  chosen  from  the  natural  conjugate  class  of 
probability  density  functions  for  this  group  of  three  problems  whose  form 
is  that  of  several  terms  as  in  (6.47)  multiplied  together  (one  for  each 
frequency  index).  Specifically 

P(“0T)  = 2TOO  expCA0  cos(NV+B0)]  , q-  < v < J 

(8.1) 

= 0 , otherwise 

where  > 0,  -n  < < ir,  and  Iq(*)  is  the  modified  Bessel  function  of  order 

zero.  For  all  cases  where  performance  is  reported  here,  N = 8 and  BQ  = 0. 

As  Figure  8.1  indicates,  varying  the  parameter  AQ  from  zero  to  infinity 
models  a wide  range  of  uncertainty  from  diffuse  to  very  precise  prior 
knowledge.  The  array  elements  are  assumed  one  half  wavelength  apart  at 
frequency  NoJq/2tt  Hz.  Thus,  (8.1)  corresponds  to  a location  uncertainty 
over  ±90°  in  physical  angle  from  broadside  to  the  array  or  ±ir  in  phase 
at  frequency  NWq/2tt  Hz.  The  parameters  A^  and  Bq  should  not  be  confused 
with  similarly  denoted  parameters  ir.  Table  6.1. 

Performance 

The  remainder  of  this  chapter  will  be  devoted  to  the  discussion  and 
comparison  of  performance  results  for  the  three  problems  enumerated  earlier. 
Each  ROC  is  labeled  by  the  AQ  value  corresponding  to  a particular  level  of 
uncertainty.  The  array  sizes  investigated  were  for  three  and  nine  elements 
as  denoted  by  the  parameter  K.  Both  the  Gaussian  noise  which  is  independent 
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from  sensor  to  sensor  and  the  additive  directional  Gaussian  noise  have  power 


spectra  which  are  white  and  bandlimited  to  N(i)q/2tt  Hz.  Their  spectral  heights 


are  denoted  by  N and  D,  respectively. 


Performance  curves  for  the  processor  which  is  to  decide  between  presence 


or  absence  of  a Gaussian  signal  of  uncertain  direction  in  Gaussian  noise 


which  is  independent  from  sensor  to  sensor  are  given  in  Figures  8. 2-8. 6. 


The  five  figures  are  for  a wide  band  signal  source  whose  power  spectrum  is 


white  and  bandlimited  to  Nw0/27r  Hz.  Its  spectral  height  is  denoted  by  S. 


The  likelihood  ratio  for  this  problem  is  given  by 


11 

A(z)  = T TT  A(z_(n)|&j  r )p(u  r )du  t 
u0Ts  n=0  s J s u *■ 


(8.2) 


where  A(z(n)L-T  ) can  be  found  in  Table  6.1  A. 
— 0 s 


Note  from  Figures  8. 2-8. 4 that  increasing  location  uncertainty  leads  to 


a greater  degradation  in  performance  the  larger  the  array  size.  The  e-  cted 


value  of  the  total  signal  energy  processed  in  Figures  8.2  and  8.3  has  been 


kept  constant  to  make  this  comparison  more  \ ’sible. 


Figures  8.5  and  8.6  evaluate  performance  for  a particular  suboptimal 


processor  which  has  been  placed  in  the  same  environment  of  uncertainty  as 


discussed  above.  This  suboptimal  processor  has  the  estimate  and  plug  struc- 


ture as  illustrated  in  Figure  3.4.  Since  the  uncertain  parameter  of  signal 


source  location  exists  under  H^  only,  6^  is  the  sole  estimate  required.  In 


this  case,  the  estimate  is  not  data  dependent  and  is  fixed  at  0^  = (W0TS)  = 0. 


The  parameter  conditional  expression  into  which  £ is  plugged  is  given  by 


ACzJe^)  - j]*  A(z(n)J<u0rs) 

n=0 


(8.3) 
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where  A(£(n)|<d.T  ) can  be  found  in  Table  6.1  A.  The  resulting  processor  is 
a realization  of  that  derived  by  Bryn  (Bryn,  1962)  with  a front  end  consist- 
ing of  a beari; former  looking  broadside  to  the  array.  Note  that  even  in  a 
relatively  ut  certain  environment,  the  subopt imal  three  element  array 
processor  lous  not  suffer  greatly  in  performance  loss.  However,  the  sub- 
ootimal  nine  ei...  srrcty  processor  suffers  a significant  drop  in  perfor- 
mance for  all  levels  of  uncertainty  less  than  precise  knowledge.  These  two 
figures  also  . ild  be  compared  to  Figures  8.2  and  8.4.  Particularly  for 
'■'.m  nine  element  .irray,  these-  results  point  out  the  necessity  of  properly 
incorporating  a priori  knowledge  into  the  array  processor  design. 

in  NKh 

Performance  curves  are  given  in  Figures  8.7-8.18  for  the  processor  which 
is  to  decide  presence  or  absence  of  a signal  known  except  for  direction  in 
Gaussian  lading  of  a component  which  is  independent  from  sensor  to 

sensor  and  an  additive  component  arising  from  a source  of  known  direction. 

The  likelihood  ratio  for  this  problem  is  given  by 


N 


= /u  x IT  A(z(n)IVs)p(Vs)  dV< 

0 s n=0 


(8.4) 


where  A(^(n)  l^ig)  can  he  found  in  Table  6.1  B.  A single  frequency  signal 
is  assumed  at  No)p/2ir  Hz.  Its  energy  over  the  observation  interval  is  given 
by  £ = 2 b^N)  bQ(N).  The  first  five  figures  are  for  a noise  component  of 
known  direction  of  zero  spectral  height.  This  reduces  the  problem  to  the 
known  signal  counterpart  of  the  GUD  problem  previously  discussed.  Perfor- 
mance for  this  special  case  of  the  optimal  processor  originally  was  reported 
by  Gallop  (Gallop,  1971;  Gallop  and  Nolte,  1974).  Those  results  are  not 
identical  to  that  reported  here  since  Gallop  assumed  the  zeroth  array  element 
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was  located  at  the  array  center  instead  of  the  array  end  as  is  assumed  here. 
The  remaining  seven  figures  are  for  a noise  component  of  known  direction  of 
unit  spectral  height. 

Note  from  Figures  8. 7-8. 9 that  increasing  location  uncertainty  leads  to 
a greater  degradation  in  performance  the  larger  the  array  size.  This  is 
particularly  evident  in  Figures  8.7  and  8.8  where  the  total  signal  energy 
processed  has  been  held  constant. 

Figures  8.10  and  8.11  evaluate  perform  since  for  a particular  suboptimal 
processor  which  has  been  placed  in  the  same  environment  of  uncertainty  as 
discussed  above.  This  suboptimal  processor  has  the  estimate  and  plug 
structure  as  illustrated  in  Figure  3.4.  Since  the  uncertain  parameter  of 
signal  source  location  exists  under  on'y,  0^  is  the  sole  estimate 
required.  In  this  case,  the  estimate  is  not  data  dependent  and  is  fixed 
at  0^  = ((oJts)  = 0.  The  parameter  conditional  expression  into  which  0^ 
is  plugged  is  given  by 

N 

A(zJeL)  = TT  A(z(n)  |u>  t ) (8.5) 

1 n=0  U s 

where  A(z(n)|w i t ) can  be  found  in  Table  6.1  B.  The  resulting  processor  is 
a realization  of  that  derived  by  Mermoz  (Mermoz,  1964;  Horton,  1969)  with 
a front  end  consisting  of  ? baamformer  looking  broadside  to  the  array.  For 
both  the  three  and  nine  element  processors,  significant  performance  degra- 
dation is  suffered  for  all  levels  of  uncertainty  other  than  precise 
knowledge.  This  is  particularly  evident  the  larger  the  array.  Once  again, 
a comparison  of  these  results  with  those  in  Figures  8.7  and  8.9  point  out 
the  necessity  of  properly  incorporating  a priori  knowledge  into  the  array 
processor  design. 


An  interesting  comparison  can  be  made  between  the  optimal  performance 
just  discussed  and  that  for  the  similar  GUD  problem  reported  in  Figures 
8. 2-8. 4.  If  performance  degradation  was  due  to  spatial  uncertainty  only, 
we  would  expect  both  problems  to  suffer  a similar-  performance  loss  as  the 
level  of  uncertainty  increased.  Note  that  the  GUO  processor  is  clearly  less 
effected  by  location  uncertainty  than  the  SKED  processor.  Thus,  spatial  and 
temporal  uncertainty  get  mixed  together.  In  effect,  it  appears  that  che 
Gaussian  signal  has  such  a large  amount  of  uncvviainty  already  inherent 
within  it  that  the  addition  of  location  uncertainty  does  little  to  degrade 
detection  performance. 

The  remaining  figures  in  this  section  are  for  a directional  noise  source 
of  unit  spectral  height.  In  Figures  8.12-8.16,  its  location  is  fixed  such 
that  No)QTn  = m/2.  Figures  8.12-8.14  correspond  to  Figures  8. 7-8. 9.  Note 
that  the  addition  of  a directional  noise  source  causes  additional  perfor- 
mance degradation  for  all  levels  of  uncertainty.  This  effect  is  less 
noticeable  in  the  nine  than  the  three  element  array  processor. 

Figures  8.15  and  8.16  evaluate  performance  for  a particular  suboptimal 
processor  which  has  been  placed  in  the  same  environment  of  uncertainty  as 
discussed  above.  This  suboptimal  processor  has  the  estimate  and  plug  struc- 
ture as  illustrated  in  Figure  3.4.  Since  the  uncertain  parameter  of  signal 
source  location  exists  under  only,  0^  is  the  sole  estimate  required.  In 
this  case,  the  estimate  is  not  data  dependent  and  is  fixed  at  6^  = 

(u)qt  ) = 0.  The  parameter  conditional  expression  into  which  6^  is  plugged 
is  given  by 


= ft  A(z(n)J  <ujs) 


I 


?.ur?  8.13.  Performance  of  the  Optimal  SKED  in  NKD  Array  Processor 
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Figure  8.15.  Performance  of  the  .Suboptimal  SKED  in  Array  Processor 
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where  A(z(n)jtf0Tg)  can  be  found  in  Table  6.1  B.  The  resulting  processor  is 
a realization  of  that  derived  by  Mermoz  (Mermoz,  1964;  Horton,  1969)  with  a 
front  end  consisting  of  a beamformer  looking  broadside  to  the  array  and  a 
nullformer  pointing  towards  the  directional  noi3e  source’s  location.  Note 
that  little  difference  is  noticed  between  these  results  and  those  reported 
in  Figures  8.10  and  8.11.  The  addition  of  a noise  source  of  known  location 
has  a small  performance  degradation  effect  in  comparison  to  the  large  loss 
introduced  by  signal  source  location  uncertainty. 

The  remaining  two  figures  illustrate  the  effect  of  varying  the  location 
of  the  directional  noise  source  for  the  optimal  three  element  array  processor. 
Figures  8.17,  8.12,  and  8.18  correspond  to  noise  source  locations  such  that 

Nuig-r^  = 3tt/4 , 77/2,  and  ir/4,  respectively.  In  this  sequence,  the  noise 

source’s  location  is  progressively  approaching  broadside  to  the  array  which 
also  is  the  mean  value  of  the  a priori  distribution  on  signal  source  loca- 
tion. Note  that  the  AQ  = 0 curve  remains  constant  while  all  the  remaining 

curves  move  closer  to  it  as  the  difference  between  the  noise  source's 

location  and  the  mean  value  of  the  signal  source's  location  becomes  smaller. 

SKE  in  NUD 

Performance  curves  are  given  in  Figures  8.19-8.23  for  the  processor 
which  is  to  decide  presence  of  absence  of  a signal  known  exactly  in  Gaussian 
noise  consisting  of  a component  which  is  independent  from  sensor  to  sensor 
and  an  additive  component  arising  from  a source  of  uncertain  direction. 

Thus,  unlike  the  previous  two  sections,  it  is  not  the  location  of  the 
signal  source  which  is  uncertain.  In  addition,  the  resulting  processor 
is  more  complex  than  the  previous  two  since  averaging  over  the  prior 
knowledge  must  take  place  in  both  the  numerator  and  denominator  of  the 
likelihood  ratio  as  shown  below 
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A(z)  = 


/„  T TT  pW”)lvn>Vp(Vnfco'n 

0 n n=0 

N 

L r TT  pM»)!v0-H.Wv,),1V. 

0 nn=0 


(8.7) 


where  p(z_(n)(i)0Tn,H^)  and  p(z_(n)fdQTn,HQ)  can  be  found  in  Table  6.1  C.  A 

single  frequency  signal  is  assumed  at  NuQ/27r  Hz.  Its  energy  over  the  obser- 

vation  interval  is  given  by  E = 2 b^CN)  bQ(N).  Note  that  the  figures  in 

this  section  correspond  directly  to  Figure  8.12-8.16  for  the  SKED  in  NKD 

problem  with  the  locations  of  the  signal  and  noise  source  reversed  (i.e., 

Noj  t *=  ir/2) . Thus,  it  will  be  possible  to  compare  the  relative 
0 s 

effects  of  signal  versus  noise  source  location  uncertainty. 

An  interesting  contrast  with  previous  results  is  seen  in  Figures  8.19- 
8.21.  Note  that  increasing  location  uncertainty  does  not  lead  to  a greater 
degradation  in  performance  the  larger  the  array  size.  This  is  particularly 
evident  in  Figures  8.19  and  8.20  where  the  total  signal  energy  processed 
has  been  held  constant.  An  actual  decrease  in  performance  loss  with 
increasing  array  size  is  seen. 

A second  contrasv  with  previous  results  is  seen  in  Figures  8.22  and 
8.23.  They  evaluate  performance  for  a particular  suboptimal  processor 
which  has  been  placed  in  the  same  environment  of  uncertainty  as  discussed 
above.  This  processor  has  the  estimate  and  plug  structure  as  illustrated 
in  Figure  3.4.  Since  the  uncertain  parameter  of  noise  source  location 

/H  A 

exists  under  H,  and  H , both  the  0,  and  0.  estimates  are  required.  In 
this  case,  the  estimates  are  not  data  dependent  and  are  fixed  at 

A A A 

0^  = 00  = (wfJTn)  = 0.  The  parameter  conditional  expression  into  which  0^ 


and  9-  are  plugged  is  given  by 
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(8.8) 


where  p(z(n)  |a>0Tn,H^)  and  p(z(n)  IwqT^Hq)  can  be  found  in  Table  6.1  C. 
Similar  to  the  previous  section,  the  resulting  processor  is  a realization 
of  that  derived  by  Mermoz  (Merrr.oz,  1964;  Horton,  1969)  with  a front  end 
consisting  of  both  a beamformer  and  null former.  The  beamformer  is  looking 
towards  the  signal  source's  location  and  the  nullformer  point ing  broad- 

side to  the  array.  Note  that  while  significant  performance  degradation  is 
suffered  for  all  levels  of  uncertainty  other  than  precise  knowledge,  the 
loss  is  nowhere  near  as  severe  as  in  Figures  8.15  and  8.16  where  it  is  the 
signal  source's  location  which  is  uncertain. 


Performance  Summary 

The  results  of  this  chapter  facilitate  an  understanding  of  the  effect 
of  both  signal  and  noise  source  location  uncertainty  on  array  processor 
performance.  Several  observations  have  been  made  and  they  are  summarized 
below. 

I 

The  detectabilities  of  a known  form  and  Gaussian  signal  of  uncertain  | 

j 

location  were  compared.  While  both  exhibited  a degradation  in  performance  , 

as  the  level  of  uncertaLrty  increased,  it  was  noted  that  the  optimal  array  : 

processor  for  a Gaussian  signal  suffered  significantly  less  in  this  respect  I 

J 

than  that  for  a known  form  signal.  I 

j 

The  remaining  comparisons  between  optimal  array  processors  were  for 
problems  involving  both  a known  form  directional  signal  source  and  a 
directional  noise  source.  A question  that  arises  immediately  is  wnich  of  , 

the  two  sources  has  a greater  effect  on  detectability  when  its  location  is  | 

uncertain.  For  the  E/N  and  D/M  ratios  investigated,  it  was  found  that  j 
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uncertainty  in  the  location  of  a noise  source  has  a less  serious  effect  on 
performance  degradation  than  a corresponding  amount  of  uncertainty  on  the 
location  of  a known  form  signal  source. 

Since  performance  results  for  two  array  sizes  were  investigated,  the 
effect  of  increasing  the  array  size  while  keeping  the  level  of  uncertainty 
constant  could  be  studied.  Whrn  there  is  signal  source  location  uncertainty, 
increasing  the  array  size  leads  to  a degradation  in  performance.  In  con- 
trast, when  it  is  the  noise  source’s  location  which  is  uncertain,  increasing 
the  array  size  does  not  lead  to  a degradation  in  pex'formance . In  fact,  a 
slight  increase  was  noted. 

An  appealing  approach  to  array  processor  design  when  uncertain  param- 
eters exist  is  first  to  estimate  these  parameters,  then  plug  them  into  the 
parameters  known  likelihood  ratio  as  if  they  were  known  exactly.  The 
performance  of  a particular  class  of  such  suboptimal  processors  operating 
in  the  same  environment  of  uncertainty  as  their  optimal  counterparts  was 
investigated.  For  this  class,  the  estimates  of  signal  and  noise  source 
location  were  not  data  dependent  and  fixed  at  zero.  The  resulting 
processors  were  realizations  of  those  derived  by  Bryn  (Bryn,  1962)  and 
Mer.iioz  (Mermoz,  1964;  Horton,  1969)  each  with  a front  end  consisting  of  a 
beamformer  and  (when  appropriate)  a nullformer.  In  all  cases,  the  sub- 
optimal  processor  suffered  greater  performance  degradation  for  a given  level 
of  uncertainty  other  chan  precise  knov.’ledge  than  its  optimal  counterpart. 
Especially  as  the  array  size  grows  larger,  the  results  point  out  the  neces- 
sity of  properly  incorpooring  a priori  knowledge  into  array  processor  design. 
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Chapter  IX 

ADAPTIVE  LEARNING  OF  AN  ADDITIVE  DIRECTIONAL  NOISE  COMPONENT'S  LOCATION 

As  mentioned  at  the  end  of  Chapter  III,  an  appealing  approach  to  an 
array  detection  problem  where  uncertain  parameters  exist  is  to  estimate 
these  parameters  and  then  plug  them  into  the  conditional  likelihood  ratio 
as  if  they  were  known  exactly.  When  "good"  estimators  are  used  in  the 
structure  illustrated  in  Figure  3.4,  the  processor  is  typically  referred 
to  as  being  adaptive.  Once  again,  however,  it  is  not  clear  that  piecing 
together  local] y optimal  techniques  will  yield  global  optimality  when  the 
overall  goal  is  good  detection  performance.  The  intent  of  this  chapter  is 
to  reiterate  that  when  implemented  sequentially,  the  optimal  array  processor 
exhibits  learning  or  adaptive  features  naturally.  Specific  cases  of  the 
SKE  in  NUD  processor  will  be  used  as  illustrations. 

Adaptive  Optimal  Array  Processors 

In  the  formation  of  the  likelihood  ratio,  the  marginal  distribution  of 
the  observables  conditional  to  each  hypothesis  is  needed.  Assume  the  total 
observation  period  has  been  broken  into  a sequence  of  incremental  observa- 
tion periods.  Adopting  the  notation  of  Chapter  V,  our  observables  are  now 
the  L vectors  (z\. . . ,z^).  Suspending  the  conditioning  to  and  HQ 

pfz1, . . . ,z_L)  =J7  pC^I^-1,. . . ,z1).  (9.1) 

i=l 

Assuming  parameter  c nditional  independence  of  the  z1  (see  Chapter  V) 
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(9.2) 


where  p( 6_| z.  >..*,z,  ) is  an  updated  version  of  the  a priori  probability 

density  function  of  Q_ 

pCeli*'1....,*1)  = E-i-^M?(fl|1~2,',i,-1>  ■ (9.3) 

P <£  I*  ••••>£> 

The  expressions  (9.1),  (9.2)  and  (9.3)  are  the  sequential  design  equations 
used  tc  form  the  marginal  distributions  required  to  calculate  the  likeli- 


hood ratio 


. r p(z1,...,zL|H1) 

A(z  ,...,z  ) = = 


p(z1,.,.,zL|H0) 


(9.4) 


iff 

II 


hi 


"11 


Figure  5.1  illustrates  the  corresponding  array  processor  structure.  The 
adaptive  feature  arises  out  of  the  sequential  Bayesian  updating  of  the  a 
priori  knowledge  of  the  uncertain  parameter  vector.  In  general,  the  numer- 
ator and  denominator  equations  in  (9.4)  must  remain  separated  in  the 
updating  sequence. 

An  Example:  SKE  in  NUD 

In  this  section,  computer  simulations  of  the  SKE  in  NUD  processor  for 
several  cases  will  be  used  as  illustrations  of  the  natural  adaptive  feature 
of  an  optimal  array  processor  when  implemented  sequentially.  The  uncertain 
parameter  in  this  case  is  the  Gaussian  noise  source's  location  reflected 
in  the  phase  term  0_  = The  parameter  conditional  joinc  density 

expressions  under  and  HQ  required  in  (9.2)  and  (9.3)  are  given  by 
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p(z1|£,H1)  = ff  pCz^CnJlo)  t ,H1) 
n=0 


(9.5) 


P^I^Hq)  = TT  pQ^CrO {“qT^’Hq) 
n=0 


(9.6) 


i.  * 

where  p(z  (n))oi  t ,H.  ) and  p(z1(n)|a>„T  ,H_)  can  be  found  in  Table  6.1  C. 
uni  — 'On  0 

The  superscript  is  omitted  in  Table  6.1  C since  the  expressions  are  the  same 
for  all  L incremental  observation  intervals. 

Figures  9.1-9,12  illustrate  single  computer  simulation  runs  of  the 
processor  consisting  of  13  iterations  each.  Since  the  uncertain  parameter 
exists  under  both  hypotheses,  two  columns  of  the  sequentially  updated  a 
priori  knowledge  corresponding  to  (9.3)  under  HQ  and  are  recorded.  Each 
probability  density  function  displays  P(WOTN)  = p^^r^l^1,. . . ,£*■)  versus 
WOTN  = ojgT^  where  ITER  = i.  The  first  density  in  each  column  (ITER  = 0) 
is  the  a priori  knowledge.  A uniform  prior  of  pto^T^)  = 4/tt  for 
-t/8  < < rr/8  was  assumed  in  all  cases.  The  "MAX"  value  indicates  the 

maximum  value  of  the  particular  density  recorded.  Between  the  two  columns 
of  densities  is  a third  column  which  indicates  the  iteration  number  ("ITER") 
and  the  value  of  the  likelihood  ratio  ("L")  at  the  completion  of  that 
iteration  as  given  by  (9.4)  utilizing  (9.1).  The  lower  left  hand  corner  of 
each  figure  records  the  incremental  signal  energy  processed  ("E"),  noise 
power  spectra  heights  ("N"  and  "D"),  and  array  size  ("K").  The  noise  spectra 
are  assumed  white  and  bandlimited  to  8w0/27t  Hz.  The  signal  consists  of  a 
single  frequency  at  8^/27?  Hz.  Its  energy  over  one  incremental  observation 
interval  is  given  by  E = 2b^(B)"bQ(S) . The  spacing  between  the  array  elements 
is  assumed  one  half  wavelength  at  the  frequency  of  rhe  signal.  The  lower 
right  hand  corner  of  each  figure  records  the  a priori  probability  density 
function  parameters  ("AO"  and  "30",  se'  1)),  the  true  hypothesis  in  force 
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during  the  simulation  ("HI"  or  "HO"),  and  the  true  location  of  the  noise 
source  reflected  in  terms  of  phase  ("WOTN").  In  all  cases,  WOTN  = u)0Tn  = 0. 

The  first  six  figures  report  single  processor  runs  for  a three  element 
array;  the  last  six  do  the  same  for  a nine  element  array.  The  figures  are 
given  in  pairs.  In  the  first,  the  true  hypothesis  in  force  is  H^;  in  the 
second,  All  figures  have  a signal-to-noise  ratio  of  E/N  = 1.  The 

noise-to-noise  ratio  (D/N)  has  the  values  .01,  .03,  and  .09.  Note  that  even 
though  the  noise-to-noise  ratios  investigated  were  relatively  low,  the 
optimal  processor  was  usually  able  to  learn  the  noise  source’s  location 
(under  the  correct  hypothesis).  It  is  interesting  that  under  the  incorrect 
hypothesis,  the  sequentially  updated  a priori  knowledge  often  peaks  up  at 
the  location  of  the  signal  source  which  in  terms  of  phase  was  WqTs  = it/16. 

As  these  figures  indicate,  the  optimal  array  processor  exhibits  natural 
learning  or  adaptive  features  when  implemented  sequentially. 


Figure  9.1.  Sequential  SKE  in  NUD  Simulation. 
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Figure  9.2.  Sequential  SKE  in  NUD  Simulation. 
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Figure  9.5.  Sequential  SKE  in  NUD  Simulation. 
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Figure  9.11.  Sequential  SKE  in  MUD  Simulation. 
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Figure  9.12.  Sequential  SKE  in  NUD  Simulation. 


Chapter  X 

SUMMARY  AND  RECOMMENDATIONS  FOR  FURTHER  RESERACH 


$ 


Summary 

This  dissertation  has  taken  a global  approach  to  the  processing  of 
inform?  ;.i  on  from  an  array  of  sensors.  Essentially,  the  unprocessed  outputs 
of  the  individual  elements  have  been  considered  as  the  observables.  The 
processor  structure  was  allowed  to  evolve  freely  with  the  sole  restriction 
being  the  criterion  of  optimality.  Such  an  approach  has  been  emphasized 
since  it  is  not  clear  that  the  imposition  of  a structure  on  an  array 
processor  which  appears  optimal  locally  (such  as  the  utilization  of  beam- 
formers,  nullformers,  and  good  estimation  techniques)  will  facilitate  the 
overall  goal  of  good  signal  processing. 

Specifically,  the  array  processors  discussed  were  to  decide  if  the 
random  processes  observed  at  the  array  element  outputs  consisted  of  a 
signal  obscured  by  noise  or  noise  alone.  Any  uncertain  parameters  in  the 
problems  considered  were  treated  as  random  variables  and  knowledge  about 
them  was  summarized  by  a priori  probability  density  functions.  The 
resulting  detectors  were  optimum  in  the  sense  of  making  a least -risk  deci- 


The  first  task,  then,  was  to  specialize  the  general  results  of  signal 
detection  theory  to  the  optimal  processing  of  data  from  an  array  of 
sensors.  The  general  form  of  the  likelihood  ratio  was  derived  based 
upon  observables  consisting  of  the  Fourier  coefficients  of  the  observed 
random  processes.  For  a stationary  noise  field  consisting  of  a component 


independent  from  sensor  to  sensor  and  an  additive  directional  component, 
the  covariance  properties  of  these  Fourier  coefficients  were  pursued  as  a 
function  of  the  observation  period  length. 

Once  the  mathematics  of  the  likelihood  ratio  has  been  written,  the 
optimal  array  processor  can  be  implemented  in  various  structures.  Four 
such  canonical  implementations  were  discussed:  (1)  one  shot,  (2)  pseudo 

estimator,  (3)  two  step,  and  (4)  sequential.  The  pseudo  estimator 
structure  was  shown  to  be  the  optimal  counterpart  of  a popular  ad  hoc 
approach  to  array  processor  design  where  any  uncertain  parameters  are 
first  estimated,  then  plugged  into  the  parameters  known  likelihood  ratio  as 
if  they  were  known  exactly.  The  general  formulation  of  the  time  sequential 
structure  revealed  that  the  likelihood  ratio  can  be  realized  by  an 
appropriate  combination  of  single  frequency  components.  Each  is  an 
independent  time  sequential  processor  which  utilizes  its  own  natural 
conjugate  prior  to  achieve  a certain  degree  of  mathematical  tractability. 

Of  particular  interest  were  three  specific  problems  involving  either 
signal  or  noise  source  location  uncertainty 

(1)  Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD) 

(2)  Signal  Known  Except  for  Direction  in  Noise  with  an  Additive 
Directional  Noise  Component  of  Known  Direction  (SKED  in  NKD) 

(3)  Signal  Known  Exactly  in  Noise  with  an  Additive  Directional 
Noise  Component  of  Uncertain  Direction  (SKE  in  NUD). 

Their  likelihood  ratios  were  derived  and  performance  reported  for  several 
levels  of  location  uncertainty  and  two  array  sizes.  Performance  was  stated 
in  terms  of  the  ROC  curve.  Several  observations  were  made.  It  was  noted 
that  the  optimal  array  processor  for  a Gaussian  signal  of  uncertain 
direction  suffered  significantly  less  in  performance  degradation  as 
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location  uncertainty  increased  than  the  corresponding  processor  for  a 
signal  of  known  form.  For  the  signal-to-noise  and  noise -to-noise  ratios 
investigated,  it  was  found  when  comparing  the  SKED  in  NKD  and  SKE  in  NUD 
processors  that  uncertainty  in  the  location  of  a noise  source  has  a less 
serious  effect  on  performance  degradation  than  a corresponding  amount  of 
uncertainty  on  the  location  of  a known  form  signal  source.  Since  perfor- 
mance results  for  two  array  sizes  were  investigated,  the  effect  of  increasing 
the  array  size  while  keeping  the  level  of  uncertainty  constant  could  be 
studied.  When  there  was  signal  source  location  uncertainty,  increasing 
the  array  size  while  keeping  the  level  of  uncertainty  constant  led  to  a 
degradation  in  performance.  No  such  performance  degradation  occurred  when 
the  noise  source  location  was  uncertain  (in  fact,  a slight  increase  was 
noted).  Lastly,  the  performance  of  a particular  class  of  suboptimal  array 
processors  operating  in  the  same  environment  of  uncertainty  as  their 
optimal  counterparts  was  investigated.  For  this  class,  an  estimate  and 
plug  structure  was  imposed  with  the  estimates  of  signal  and  noise  source 
location  not  being  data  dependent. 

Although  an  estimate  and  plug  structure  is  appealing  due  to  its  explicit 
adaptive  characteristics,  it  was  shown  that  the  optimal  array  processor 
exhibits  natural  learning  or  adaptive  features  when  implemented  sequentially. 
Computer  simulation  runs  of  the  SKE  in  NUD  processor  were  used  to  illustrate 
the  Bayes ian  updating  which  occurs  as  an  integral  part  of  the  sequential 
structure. 


Recommendations  for  Further  Research 

In  the  pursuit  of  a particular  piece  of  research,  it  is  not  uncommon 
for  several  new  and  interesting  questions  to  surface.  This  work  is  certainly 


no  exception. 
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Chapter  V presented  the  formulation  of  the  time  sequential  array- 
processor  in  general  terms.  The  resulting  detector  structure  illustrated 
in  Figure  5.2  consisted  of  several  independent  single  frequency  components. 
Within  the  framework  of  such  a decomposition,  it  would  be  interesting  to 
pursue  the  feasibility  of  a real-time  implementation  of  the  time  sequential 
array  processor.  Conceivably,  each  single  frequency  component  would  consist 
of  a separate  minicomputer  dedicated  to  processing  the  Fourier  coefficients 
at  a single  frequency  index. 

Another  question  of  a more  theoretical  nature  arises  in  connection  with 
the  sequential  Bayesian  updating  of  an  uncertain  parameter's  probability 
density  function.  Under  the  correct  hypothesis,  estimators  such  as  the 
MLE  (maximum  likelihood ) and  MAP  (maximum  a_  posteriori ) have  well  known 
properties.  But,  what  is  their  nature  under  the  incorrect  hypothesis? 

For  example,  in  Chapter  IX  it  was  noted  that  the  a posteriori  density  of 
noise  source  location  would  often  peak  up  in  the  direction  of  the  signal 
source  under  the  hypothesis  opposite  that  actually  in  force. 

Chapters  VI  and  VIII  presented  detailed  derivations  of  the  likelihood 
ratio  and  performance  results  for  three  specific  problems  involving  either 
signal  or  noise  source  location  uncertainty.  Their  performance  was  compared 
to  a particular  class  of  suboptimal  array  processors  with  an  estimate  and 
plug  structure  to  demonstrate  the  necessity  of  properly  incorporating  a 
priori  knowledge  into  array  processor  design.  The  particular  class 
studied  was  that  where  the  estimates  were  not  data  dependent.  A valuable 
extension  of  those  results  would  be  the  calculation  of  performance  when 
data  dependent  estimators  such  as  the  MLE  or  MAP  are  used. 
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Appendix  A 

COVARIANCE  ARISING  FROM  A SCALAR  RANDOM  PROCESS 


The  following  derivation  of  the  covariance  between  the  Fourier  coeffi- 
cients representing  a sample  function  of  a scalar  random  process  is  taken 
from  Blachman  (Blachman,  1957). 

Consider  the  series  expansion  of  a sample  function  z(t)  from  a zero 
mean  real  random  process  over  the  interval  ( -T/2, T/2) 

N , 1/2 

z(t)  = l.i.m.  I z(n)(£)  exp(jnu)  t)  , |t|  < T/2  (A.l) 

N -»-  <»  n=-N 

, 2tt 

where  «Q  = y 

1/2  T/2 

and  z(n)  = (~)  / z(t)exp(-jneo  t)dt  . (A. 2) 

-T/2  0 


Thus,  the  covariance  between  any  two  coefficients  can  be  expressed  as 


E[z(n)z(m)*] 


T/2 

/ E[z(u)z(t)]exp[-ju)  (nu-mt)]  du  dt  . 
-T/2  0 

(A. 3) 


Making  the  substitution  t + x = u -*•  x = u~t 


E[z(n)z(m)*3 


T/2  T/2-t 

f ! E[z(t+x  )z(t  )]exp{-ja>  [(n-mjt+nt]}  dx  dt  . 

-T/2  -T/2-t 

(A. 4) 


Assuming  z(t)  is  stationary  (in  the  wide  sense),  E[n(t+x)n(t)]  = R(x)  and 

T/2  T/2-t 

E[z(n)z(m)  ] = = / / R(x)exp{-jco.[(n-m)t+nx]}  dxdt  . 

-T/2  -T/2-t 


(A. 5) 
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By  the  Wienei'-Khinchin  theorem 


CO 

r(t)  = 2rr‘  / N(o))exp(  junOdo) 


(A. 6) 


where  N(o>)  is  the  power  spectral  density  function  of  the  random  process. 
Thus,  (A. 5)  becomes 


A 1 T/2  T/2-t  co 

E z nlzfm)  ] - — / / / N(oj)exp[a)  (m-n)t]exp[jT(-no)  +u)]  dio  dt  dt  . 

-T/2-T/2-t-»  u 0 


(A. 7) 


Note  that 

T/2-t 

f 

-T/2-t 


/ expCjT(-na)0+u))]dT  = expCjT(-nu)0+a))] 


T/2-t 

-T/2-t 


J(-nu>  +o>)'  GXP 1 ["  j ( -n  V*0 ) * 3< expC  jT/2 ( -nu  +to ) ]-exp[ j ( -T/2 ) ( -n^+u, ) ] } 


‘(-na)0+u)  exPf-3v'-nw0+aj)]sin  T/2(-nw0+aj)  . 


(A. 8) 


After  interchanging  the  order  of  ’.dregration  in  (A. 7) 
E[z(n)z(m)'c] 


l “ T/2  sin  T/2(-nu  +u) 


_ X / r ' ' —WQ.w/ 

" "wT  _T/2  N(tu)  (-nun+M)  exPf-:(-nu0+a))t]exp[ja)0Cm-n)t]  dt  du 


x » T/2  sin  T/2(-n»  +a») 

= *T  L -t/2  N(W>  ^«0+to) exp[j(ma)0-(o)i 


)tj  dt  da)  . 


(A. 9) 


Using  the  relationship  in  (A. 8)  to  integrate  over  t 


i /’ «.)  !in_T/2('nV“>  •*» 


(-naiQ+o)) 


(mo)0-o))  dt0 


0 


0 


! ! 


(A. 10) 
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Making  the  substitution  a>  = xuQ  -»■  x = oi/uiQ 
2 u»  » 


ECz(n)z(m)*3  = - J£  f N(xaj  > sin  ;'nV%)  sin  ir/a^in^-x^) 
ffT  _»  0 (-n(D0+xa>0)  (mu0~XM0) 


= / N(xw„)  — (x~r!.)  w (x-m)  dx 
_»  0 ir(x-n)  ir(x-m)  * 


(A 


The  covariance  between  any  two  Fourier  coefficients  now  can  be  written 

* 00 

E[z(n)z(m)  ]-  / N(xiOg)  sinc(x-n)  sinc(x-m)  dx  (A 


where 


sinc(x)  = -S— n v — 

7TX 


Note  the  crthonormal  property  of  sinc(x) 

00 

/ sinc(x-n)  sinc(x-m)  dx  = 6 


where 


nm 


nm 


1 , n = m 

0 , n i m 


(A. 


■ dx 

.11) 

as 

.12) 

13) 


v*3-  J 
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Appendix  B 

COVARIANCE  MATRICIES  FOR  BANDLIMITED  WHITE  GAUSSIAN  NOISE 


This  section  contains  a set  cf  five  covariance  matricies  (Figures  B.l- 
B.5)  which  represent  successive  doubling  of  the  observation  period  length 
(Marshall,  1973).  The  Fourier  coefficients  representing  a sample  function 
from  the  scalar  random  process  are  related  by  the  expression 


oo 

E[z(n)z(m)*]  = / N(xai0)sinc(x-n)sinc(x-m)dx  (B.l) 

— OO 


, 2tt 

where  a>0  = — 


N(xWq)  = power  spectral  density  function  of  the  random  process 


and 


sinc(x)  = 


sin(7rx) 

(rrx) 


The  spectrum  considered  is  thac  of  unit  height  white  Gaussian  noise  band- 
limited  to  W Hertz.  In  the  first  covariance  matrix,  the  observation  length 
is  such  that  W = . 5u>0/2ir  or  T = .5W.  In  the  fifth  covariance  matrix,  the 
observation  length  is  sixteen  times  longer  (i.e.,  W = 8o>0/27t  or 
T = 8/W) . Note  how  the  covariance  matricies  become  progressively  more 
diagonal  in  form  as  T is  increased. 
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Appendix  C 


COVARIANCE  ARISING  FROM  A VECTOR  RANDOM  PROCESS 


Consider  the  vector  of  sample  functions  z(t)  from  the  zero  mean 
stationary  vector  random  process  observed  as  the  collection  of  outputs  from 
all  the  array  elements.  Appendix  A has  already  derived  the  relationship 
between  the  Fourier  coefficients  representing  a single  element’s  output. 
When  the  noise  field  contains  an  additive  directional  noise  component,  the 
Fourier  coefficients  arising  from  the  outputs  of  two  different  array  ele- 
ments will  become  related  since  a portion  of  the  random  process  observed 
at  one  element  simply  will  be  a time  delayed  version  of  that  observed  at 


another.  Let 


z£Ct)  8 d£(t) 


*k(t)  = V'-V 


(C.l) 


where  t£k  is  the  time  delay  between  the  and  k elements  of  the 
directional  noise  component  d£(t).  The  Fourier  coefficients  representing 
each  observed  waveform  are 


, 1/2  T/2 

z£(n)  = C^)  / d£(t)exp(-jnu0t)  dt 

1 1/2  T/2 

2^ Cm)  = (-)  / d£(t-T£k)exp(-jmu)0t)  dt 


(C.2) 


1/2  T/2-t. 


1 ' 

= exp(-jmaJ0T£k)  • C-^-)  / 


T/2-t. 


d£(t)exp(-jmm0t)  dt 


(C.  3) 


Thus,  the  covariance  between  these  two  coefficients  can  be  expressed  as 
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E[zJl(n)zk(m)  |r£k3=  exp(- 


1 rT/2"^k  ,T/2 

• r * / 

-T/2-T£k  -T/2 


/ E[d  (u)d  (t)]exp[-jo)  (nu-mt)]  du  dt 

m I ~ ^ 


(C.4) 


The  remainder  of  the  derivation  is  similar  to  that  pursued  in  Appendix  A 
with  the  following  exceptions 


(1)  (A. 6)  becomes 


Q O 

R(t)  = / D(u)exp( jut)  do) 


(C.5) 


where  D(w)  is  the  power  spectral  density  function  of  the  directional  noise 
(2)  (A. 9)  and  (A. 10)  become 


E[z£(n)zk(m)''|x£k]  = exp(-jma)0T£k) 


» T/2-t  , sin  T/2(-nio_+uj) 

-=■  / / D(w)  /■  - ••••  \ exp[j(ma)  -aj)t]  dt  da) 

ifT  ' \/0  l-na)  +0))  r 0 

" ~T/2~Ti!.k  0 


exp(-jma)0T£k) 


2 00  sin  T/2(-na)  +a>)  sin  T/2(ma>0-u>) 

-xr  / D(a))  7 r—s 7 s exp[-j(ma>  -o>)t0,  ] dw 

ttT  1 (-na)„+a))  (ma)„-a))  0 £k 

-<*>  0 0 


and  (3)  (A. 12)  becomes 


(C.6) 


E[z£(n)zk(m)1'|T£k]  = exp(-jma)QT£k) 


/ D(xa)Q)sinc(x-n)sinc(x-m)exp[-j(x-m)(--Y— )2tt3  dx.  (C.7) 


An  interesting  special  case  of  (C.7)  occurs  when  D(xa)Q)  is  white 
(i.e.,  D(xo)q ) is  not  a function  of  xo>q)  and  n = m.  Setting  D(xc!'q)  = D 


. 2 
E[z^(n)z^(n)  = expC-jin^T^)  • D / sine  (x~n)exp[-j  (x-n)(- 

“ 2 

= exp(-jnu)0T2k>  • D / sine  (f  )exp[j27rft]df 

—CO 

where  f = x - n and  t = • 

Note  the  Fourier  transform  pair 

At  sine2  fx 


AA(t/t) 


ms 


Appendix  D 

COVARIANCE  BETWEEN  ADJACENT  OBSERVATION  VECTORS 


The  total  observation  period  now  will  be  broken  into  several  smaller 
incremental  periods.  Thus,  the  vector  of  sample  functions  observed  at  the 
outputs  of  all  the  array  elements  will  be  represented  by  a sequence  of 
observation  vectors  z1.  In  this  section,  the  covariance  between  the  Fourier 
coefficients  of  adjacent  observation  vectors  will  be  derived.  Assume  the 
noise  field  consists  of  a portion  which  is  independent  from  sensor  to 
sensor  plus  an  additive  directional  noise  component.  Let 

z^(t)  = n^(t)  + d^(t) 


i+1  i+l1J.\  . .i+l^ 

h ‘ \ lt>  + dt  (t-T»k) 


(D.l) 


= n^(t+T)  + d^Ct+T-x^) 

where  n1(t)  and  n^+1(t)  are  the  portions  of  the  observed  waveforms  due 
to  the  independent  noise,  d^(t)  and  d^+^(t-T^)  are  due  to  the  directional 
noise  component,  and  x^  is  the  time  delay  between  the  l and  k 
elements  of  the  directional  noise.  The  Fourier  coefficients  representing 


m 


each  observed  waveform  are 

1/2  T/2  . 

~.^(n)  = (|-)  / [n*(t)  + d^(t )]  exp(-jna)Qt)  dt 


(D.2) 


1/2  T/2 

z^+1(m)  = (^r)  / [n^(t+T)  + d^Ct+T-x^jexpC-jmwQt ) dt 


111135 


TT^ * ■JUS5B14  ' "V-  , 


rasa 
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1/2  3T/2 

expC-jmu  T]  • (i)  / n*(t)  exp(-jmo)nt)  dt 

o i T/2  K 


1/2  3T/2-T 

+ exp[-jma)  (T-t  )]‘(^)  / **  dj(t)exp(-jmu)  t)  dt  . 

0 £k  T T/2-Tjtk 


(D.3) 


Assuming  the  independent  and  directional  noise  are  independent,  the  covari- 
ance between  these  two  coefficients  can  be  expressed  as 


E[zJ(n)z^+1(m)*|T£k]  = exp[-jmu)0(T-T£k)3 


, 1/2  3T/2-T  T/2  i i i i 

(^■)  / k / ECn^tJn^uHd^tM^u)] 


T/2-T£k  -T/2 


• exp[-ju)0(nu-mt)]  du  dt  . 


(D.4) 


Note  that  E[n£(t )n^(u)]  = 0 , i i k . 


The  remainder  of  the  derivation  is  similar  to  that  pursued  in  Appendix  C 
with  the  following  exceptions 
( 1 ) ( C . 5 ) becomes 


oo 

R(t)  = ~ I [N(o))+D(o>) j exp(jcot)  do> 


(D.5) 


(2)  (C.6)  becomes 


ECz£(n)zk+1(m)*|x£k]  = exp[-jmu)0(T-T£k)J 


0 “ sin  T/2(-nun+w)  sin  T/2(maj  -u) 

if  / CN(u))*  6£k+D(w)]  1r—~) exp[-j (w-mu0(t-T£k)]  du 


where  6 


Ak 


1 , l - k 
.0  , l i k 


(D.6) 


li 


. l 


M a tfi-.  n * 


SSSKSii 


■’  fc  • o-, 


v£»o  >vV-,r;..'f»>»s'.v 


and  (3)  (C.7)  becomes 


E[z^(n)z^+1(m)*|Tlk]  = expC-jm^d-T^)] 


A»k 

/ [N(xto0)*6ik+D(x«0)33inc(x-n)sinc(x-m)exp[-j (x-m)(l-  — ^ — )2tt J dx 


(D.7 ) 


In  a fashion  similar  to  Appendix  C,  an  interesting  special  case  of 
(D.7)  occurs  when  both  N(xoJq)  and  D(xwQ)  are  white  and  n ~ m.  Setting 
N(xwQ)  = N and  D(xuQ)  = D 

E[zJ(n)zk+1(n)*ir£k3  = expt-jnco^T-T^^*  [N*6£k+D3 

co  x 

• / sinc2(x-n)exp[-j  (x-n)(l-  dx 


= expC-jna)0(T-x&k)  • [N*6;k+D3 
j*  sinc2(f  )exp(j2Trft)  df 


(D.8) 


where  f = x - n 


and  t = x^/T  - 1 . 


Thus,  making  use  of  the  Fourier  transform  pair  in  (C.9) 


E[z^(n)z£+1(n)*|T£k3  = expC-jnu0(T-rjlk)3  • CN‘64k+D3  • ( 


-10  12 


(D.9) 


h 1' 
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Appendix  E 
MATRIX  INVERSION 


The  covariance  matricies  encountered  in  the  problems  discussed  in 
Chapter  VI  can  be  inverted  using  a technique  due  to  Bartlett  (Bartlett, 
1951).  Let  the  matrix  to  be  inverted  be  of  the  form 


Aq  = B + c d 


(E.l) 


where  A^  and  J3  are  K x K matrices  and  £ and  d are  K-dimensional  column 
vectors . Proceeding  formally 

A0“1=  (B  + c d*)-1 

= " £ d V1  + (cdV1)2,..) 

= B-1  - B"1 £ d*B~X{l  - d*B-1c  + (d*B_1c  )2- . . . } 


•v  -1 

where  we  note  that  d'13  c is  a complex  scalar.  Summing  the  geometric  series 
completes  the  derivation 


-1  ft  -1 

B £.d.  3 
1 + d*B_1c 


(E.2) 


This  result  can  be  extended  as  follows.  Let  the  matrix  to  be  inverted 
be  of  the  form 

* * 

A^  = 13  + £ d_  + £ f 


= ^ + ef 


* 


(E.3) 


where  £ and  f are  K-dimensional  column  vectors.  Thus,  utilizing  (E.2) 

A e f*A 

A-i=  A-i.  . 

-1  i./i,1. 


(E.4) 


mmm 


Appendix  F 

THE  CALCULATION  OF  PERFORMANCE  FOR  LIKELIHOOD  RATIO 


PROCESSORS  VIA  COMPUTER  SIMULATION* 


A complete  description  of  an  optimum  detector  includes  not  only  the 
likelihood  ratio  A but  also  the  processor’s  ROC (receiver  operating  charac- 
teristic) curves.  The  false  alarm  probability  Pp  and  detection  probability 
PD  are 


PF  = / p(A|H  ) dA 
n 


(F.l) 


Pn  = / p(A|H  ) dA 
n x 


(F  .2) 


where  n is  the  detection  threshold  value  and  p( A j HQ ) and  p(A|H^)  are  the 

probability  density  functions  of  A under  the  two  mutually  exclusive  and 

.. 

exhaustive  hypotheses  H^  that  a signal  is  present  and  HQ  that  it  is  not. 

Peterson,  Birdcall,  and  Fox  (Peterson,  iirdsall,  and  Fox,  1954)  have  shown 


p(A|H1)  = Ap(A|H0) 


Thus,  PQ  may  be  written  equivalently  as 


PD  = / Ap(A|H0)  dA 


(F  .3) 


(F.4) 


The  expression  (F.4)  is  particularly  valuable  when  the  densities  of  A 
under  the  two  hypotheses  cannot  be  determined  analytically.  Typically,  one 


* The  text  of  this  appendix  has  been  accepted  for  publication  in  the  IEEE 
Trans,  on  Information  Theory  (Hodgkiss  and  Nolte,  1975). 
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then  carries  out  a Monte  Carlo  simulation  of  the  optimum  processor  and  from 
his  results  forms  estimates  p(A|Hq)  and  p(A|H^)  of  the  desired  densities. 

We  see  that  (F.4)  implies  that  only  the  density  under  Hq  actually  need  be 
obtained.  One  clear  benefit  of  this  approach  is  eliminating  the  need  to 
simulate  the  signal  (which  may  contain  uncertain  parameters)  along  with 
the  noise  to  provide  receiver  input  under  H^.  Here  we  make  the  distinc- 
tion between  the  optimum  processor  which  contains  both  signal  and  noise 
parameters  and  the  simulated  input  to  the  processor  which  may  consist  of 
noise  alone  or  signal  plus  noise  depending  on  whether  the  true  hypothesis 


is  Hq  or  H^. 


Note  that  (F.4)  places  a great  deal  of  emphasis  on  the  upper  tail  of 


p(A|HQ).  An  equivalent  expression  is 


PD  = 1 - / Ap(A|HQ)  dA  . 


(F.5) 


For  many  problems,  particularly  those  whose  underlying  statistics  are 
Gaussian,  p(A|Hg)  will  have  both  a large  portion  of  its  probability  mass 
concentrated  in  the  region  A < 1 and  a long,  slowly  decaying  tail  extending 
to  infinity.  We  would  expect  any  computer  simulation  to  generate  only  a 
few  observations  in  this  extended  tail  region.  Any  calculation  which 
emphasizes  these  points  (such  as  the  first  moment)  will  be  strongly  affected 


by  their  exact  location.  In  this  case,  the  emphasis  arises  out  of  the 
multiplication  of  p( A j HQ ) by  A.  Thus,  (F.5)  is  proposed  as  a more  desirable 
means  of  calculating  PD  than  (F.4)  from  the  standpoint  of  utilizing  numerical 
simula-ion  results  since  it  avoids  heavily  weighting  the  tail  region  as  much 


as  possible.  A more  quantitative  rationale  is  discussed  in  the  appendix. 
Summarizing  the  relevant  equations  for  estimating  the  ROC  we  have 


I 


5 


I 
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OP 

PF  = /n  p(A|H0)  dA  (F.6) 

Pn  = 1 - /n  Ap(A|H  ) dA  (F.7) 

0 

where  the  circumflexes  denote  estimates  of  the  true  values. 

If  we  had  been  unaware  of  the  ’ )ng  upper  tail, instead  of  (F.7)  in  calcu- 
lating the  ROC  we  might  have  used 

CO 

P£  = / Ap(A|H0)  dA  . (F.8) 

n 


Note  that  (F.7)  may  be  rewritten  as 

oo  cti 

P = 1 - / Ap(A|H  ) dA  + / Ap(A|HQ)  dA 

0 n 

- 1 - E{A|H0)  + P£  . (F.9) 

where  E { A | HQ } is  the  first  moment  of  p(A|HQ). 

The  following  example  will  illustrate  the  error  incurred  in  using 
(F.6)  and  (F.8)  instead  of  (F.6)  and  (F.7).  We  consider  the  problem  of 
detecting  a Gaussian  signal  in  Gaussian  noise  in  which  ihe  covariance 
matrices  are  diagonal  and  the  samples  have  equal  variances,  as  discussed 
by  Van  Trees  (Van  Trees,  1968).  The  likelihood  ratio  is 

A(R)  = 


ig1/2 


M 


exp 


2 2 2 
2a  a +o  i=l 
n n s 


i K 


$ 

< 


(F .10) 
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ROC's  resulting  from  25  Monte  Carlo  simulations  of  N = 2000  runs  each 
were  calculated.  The  output  of  each  run  was  a single  value  of  A conditioned 
to  Hq,  not  just  a sufficient  statistic.  The  density  p ( A | > was  non-negative 
and  its  zeroth  moment  was  constrained  to  be  unity.  No  constraint  was  placed 
on  the  first  moment.  False  alarm  and  detection  probabilities  were  calculated 
as  follows 


PF  = K E 1 


(F.ll) 


A 


(F.12) 


where  the  summations  extend  over  all  A > o>  and 


PD  = 1 - H E A 


(F.13) 


where  the  summation  extends  over  all  A < n.  The  mean  value  ROC's  are  shown 
in  Figure  F.l  along  with  two  representative  95%  confidence  intervals  on 
detection  probability.  The  triangles  represent  mean  (Pp,P„)  points  cal- 
culated using  (F.12)  and  (F.ll);  circles  represent  mean  (P^,Pp)  points 
calculated  using  (F.13)  and  (F.ll).  Note  particularly  the  large  variance 
associated  with  calculating  detection  probability  via  (F.12)  as  opposed  to 

A A A 

(F.13).  A detailed  account  of  Pp,  P^,  and  Pp  means  and  variances  for  the 
threshold  values  investigated  is  given  in  Table  F.l.  The  mean  (PD,P_.) 
points  describe  an  ROC  that  is  essentially  equivalent  to  known  analytic 

A A 

results  (Van  Trees,  1968)  while  the  mean  (P^,P„)  points  differ  significantly. 


Appendix 

A theoretical  model  of  a standard  histogram  estimator  for  p(A|HQ)  also 
suggests  the  use  of  (F.7)  instead  of  (F.8)  for  the  estimation  of  detection 
probability.  As  a specific  example,  the  same  Gaussian  signal  in  Gaussian 
noise  problems  discussed  in  the  text  will  be  used. 


^<fr*s,***y3ftSgt?^y^i^^  vt%^.^.<^>',»<‘’!s>?^  - ■)t  y*v<-'  **■■*  *>ts^\  ^ t *w^*$*«i  • t \ r«>or*^»yv-*t  «wt yr;»»w»f  <-r*<»?ft*. 


■ '] 


Let  p(a]Hq)  be  our  histogram  estimator  of  p ( A } H (^ ) consisting  of  K = 250 
cells  each  of  width  A A = .2  and  an  end  cell  representing  all  probability 
beyond  the  truncation  point  T = 50.  The  distribution  of  observations  in  the 


i cell  is  binomial  with  parameter  p^  and,  as  a simplification,  the  distri- 
butions will  be  assumed  independent  from  cell  to  cell.  (In  a u.ality,  the 
joint  distribution  of  observations  in  all  cells  is  a multimii’al  in  the 


K + 1 parameter  family  of  distributions.)  The  discrete  versions  of  (F.6), 


(F.  7),  and  (F.8)  are 


Ktl 

PF  - I , PilH0 

i — r»  * 


(F.14) 


n’-l 

P = 1 - y A.P. 

D .L,  l l 1 0 


(F.15) 


K+l 

Pn  = l A.P. I 
D . , i i1  0 

i-n’ 


(F.16) 


where  A^  and  P^IH0  are  the  likelihood  ratio  and  false  alarm  probability 
associated  with  the  i^  cell  and  n1  is  the  cell  identifier  corresponding 
to  a threshold  value  n- 

Our  comparison  of  (F.15)  and  (F.161  will  consist  of  calculating  RCCs 
based  on  each  and  evaluating  var(P^)  and  var(P^)  for  various  values  of  n1. 

The  equation  resulting  in  the  larger  value  of  bias  and  variance  will  be  con- 
sidered the  least  desirable  of  the  two.  For  a single  cell 


var(pil"o)  = ir 


(F. 17 ) 


wthre  N equals  the  total  number  of  observations.  Since  independence  between 
cells  is  assumed 


™r(PD)  = I A?  i P (1-p  ) 
1 = 1 


(F.18) 


(F. 19) 


|V  a/ 


M 


Using  a known  analytic  expression  for  p(A |Hq)  to  derive  values  of 
(Van  Trees,  1968),  the  ROC's  in  Figure  F.2  were  calculated.  Also  shown 


are  two  representative  95%  confidence  intervals  on  detection  probability. 


Note  particularly  the  large  variance  associated  with  calculating  detection 


probability  via  (F.16)  as  opposed  to  (F.15).  A detailed  account  of  Pp, 


Pp,  and  PD  along  with  their  variances  is  given  in  Table  F.2.  This  ana- 


lytic investigation  complements  the  empirical  results  of  the  Monte  Carlo 


simulation  study.  Both  suggest  that  the  calculation  of  detection  proability 


with  the  aid  of  (F.3)  is  less  biased  and  less  variant  when  using  (F."’) 


instead  of  (F.8)  for  data  arising  from  a simulation  of  the  likelihood  ratio 


under  H^. 


&*&»**■  1 


95% 

confidence 

A 

95%  confidence 

PD 

o 

PD  and  PF 

A 

PD  and  PF 

Pn  and  P (Van  Trees,  1968) 

Figure  F.2.  ROC's  from  Histogram  Model. 


Appendix  G 
COMPUTER  PROCRAMS 
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The  computer  programs  used  in  obtaining  the  optimal  array  processor 
performance  reported  in  Chapter  VIII  are  listed  below.  Four  sections 
compromise  this  appenidx 

(1)  Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD) 

(2)  Signal  Known  Except  for  Direction  in  Noise  with  an  Additive 
Directional  Noise  Component  of  Known  Direction  (SKED  in  NKD) 

j (3)  Signal  Known  Exactly  in  Noise  with  an  Additive  Directional 

Noise  Component  of  Uncertain  Direction  (SKE  in  NUD). 

The  fourth  section  contains  general  programs  which  are  shared  by  those  in 
- the  first  three  plus  the  program  which  calculates  detection  and  false  alarm 

I 

! probabilities. 

i 


i 

f 

» 


The  Monte  Carlo  simulations  were  performed  on  a Digital  Equipment 
Corporation  PDP-9  computer.  Each  problem  was  broken  into  a sequence  of  two 
steps  as  illustrated  in  Figure  7.1.  In  the  first  step,  Gaussian  random 
numbers  (mean  zero,  variance  one)  are  read  from  a magnetic  tape.  For  each 
simulation  run,  the  collection  IG^/Gg,6^,6^}  is  calculated  and  then  written 
on  another  magnetic  tape.  Each  collection  is  read  during  the  second  step 
and  the  remaining  numerical  integrations  are  performed.  As  they  are  cal- 
culated, the  likelihood  ratios  are  written  on  a DECtape  which  is  eventually 
read  by  the  program  which  calculates  detection  and  false  alarm  probabilities. 
Several  important  concepts  in  the  calculation  of  performance  for  likelihood 
ratio  processors  via  computer  simulation  are  discussed  in  Appendix  F. 


Gaussian  Signal  of  Uncertain  Direction  in  Gaussian  Noise  (GUD) 

f 

. j 


(See  SKE  in  NUD  Section  for  "SUBROUTINE  GAUSS1") 
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GAlfSSt  AN  SIGNAL  OF  MNCSRTAt  N DIRECTION  I N GAUSSIAN  .'JO  I 

s 

»ART  | 


<A  OTF I 1 J SA  QTFR  R 

°ROG'?A<  CALLS  S'JHROUT  t •'JUS  IN,  OUT,  »ARA-1I,  ORDER,  AND  SKIP 
I 'V I T £ ALINING 

DIMENSION  £ R ( 10),  /.lCl6>,  INO<  i 00)  , AOAIIO,  10),  ARK  10,  »0), 
I G ( 10),  AMR  U 100),  AMI  l(li)O) 

connon  xkrso ),  xrirso> 
ixxx*rs  i 

IYYY=»1 
IML0CK*0 
SOT-SORTI !?,  ) 


IfJDifr  «ARAXETERS 

CALL  °AR  AN ! < I SX 1 °,  4 , X,  I ROUS } 

I Ft  t AXl  o.NE.  0)  CALL  SX  I °(  I , I S < I a> 

ORDER  RANOLER  FOR  OUTPUTTING  SUFFICIENT  STATISTICS 

CALL  OROERIN, K I , I NO, MUM > 

DO  ROD  J.Ja  |,  l Ri/fJS 
00  I AO  >H=r|,N 

SINGLE  FaEOUENCY  CONDITIONAL  SOLUTION 

00  1 00  J»|,< 

CALL  tN(7.R<  I ),  I XXX) 

1 F<  X 1.  EO.-l  ) ERI I > 3S0T«ER< l ) 

CALL  IN(EICI), l XXX ) 

IFI'M.SO. I)  ?!(!)= 0. 

G(M 1)*0. 

00  I I 0 I » I , X 

G(XX)  * O(NN)  ♦ £R(  I >*'.RCI)  s-  Et<I)«4I(t) 

00  130  L*  J,K1 
CLR-»0. 

KL»X-L 

00  IRO  I*  I, XL 
!L=*I»L 

CLR=«  CL’>  »■  7.RC  I ) «<R(  It)  ->  !I(|j»/.HIL) 

CLI*  CLI  * ER<I>*'KIL>  * Hi  l )*4'K  IL> 

AR»< 1 1,  L) *CLR 
AHKH,  L)=»CLl 
CONTINUE 


COMBINE  SINGLE  FAE-WENCY  CONDITIONAL  SOLUTIONS 


GG*0, 

00  ISO  MX*I>M 
GO*  GOG  OH.' 

00  ISO  1*1,  100 

A<3'-mi>*o. 

AHt  t C I > =* 0. 

00  ISO  MS*  !,.* 

DO  170  L*l,Kt 
INDEX*  CNN-DoL  + I 

ASS  I < IMOEX)  * ASS  U INDEX)  ASSUMED 
AS!  I(  INDEX)*  AS1KIN0EX)  «•  ASICNM,L> 
CONTINUE 


OUTWIT 

CALL  OUT<  GG,  I '('('ft  I OuOCX  ) 

DO  WO  1*1,  NUN  ' 

HINDI  I) 

CALL  OUT < ASS  !<•!),  tYYY,  I SLOC-O 
CALL  OUT < ASI  1(1),  IYYY,  I SLOCK > 

END  OF  ONE  SMULAflON  SUN 


I F(M. NE.  < |.J/ I 00)  *100)  (JO  TO  20  0 
VStTE(<J,  1)5)  ./.J 

F0SMAT(2X, l SHAUNS  COMPLETED*,  l 5) 
continue 

CALL  0UT<0., 2S0, ISLGCX) 

VSI TE( 6, 2 I 0)  I BLOCK 
F0'HAT(/2X,  VSI  SLOCK*,  13) 

STOP 

ENO 
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C SUBROUTINE  INPUTS  PARAMETERS  FOR  GAUS I 

C 

SURROUTI UP  PARAM I ! I SK  I P,M,  X,  I RUNS) 

WRITE! 6» 1 ) 

1 FORMAT!  /2X#  .16KGL0CKS  ! I SKIP)  TO  UK  SHIPPED  ON  TAPE/) 

READ! 5#  5)  I SKIP 
5 FORMAT IIS) 

WRITE! 6>  7)  I SK I ° 

7 FORMAT ! /2Xj  6WI SKI  P»* 10) 

WRITSI6,  10) 

10  FORMAT!  /2'<*  A2HNJJ.MBER  OF  FREQUENCIES  !.M>  AND  ELEMENTS  !K)/) 

READ! S*  20)  «j  K 
20  FORMAT 1918) 

WRITE!  <S>  00)  >M*  K 

SO  FORMAT! /%"<>  PH M*>  1 2#  SX,2HK»,  12) 

WRITE!  6#A0) 

AO  FORMAT! /2X»  IAHNIJM8ER  OF  RIJNS/) 

READ!  5*  SO)  I RIJNS 
SO  FORMAT! IS) 

WRITS! S>  AO)  I RUNS 
AO  FORMAT! /2X»  SKRIJNS*#  IS) 

RETURN 

END 
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C 

0 

c 

c 

0 

c 

c 

c 


c 

c 

c 


c 

c 

c 


c 


■ c 

0 

c 

c 


!0 

C 

C 

C 


30 
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GAUSSIAN  SIGNAL  OF  UNCERTAIN  DIRECTION  IN  GAUSSIAN  NOISE 
PART  II 

SA  DTE  I I I SA  0TF2  2 

PROGRAM  CALLS  SUBROUTINES  IN,  OUT,  PAR.M2U,  ORDER,  SKIP, 
BESNIS,  GAUSS!,  FG2IJ 


INITI ALIEING 

DIMENSION  FI ( SO),  PI < 200) , A<20,20> 

COMMON  X! ( 250) , X2(250>,  IND(IOO),  A3R< l 00) , A3I( 100), 
1 C,  AIOAO,  CONST,  AOCBO,  AOSBO,  M,  MUM 
I XXX* 25 l 
I YYY* I 
I BLOCK* 0 

INPUT  PARAMETERS 

CALL  PARM2UC I SK I P,M,  K, I RUNS,  S,  AN,  AOsBO) 

IF(ISKIP.NE.O)  CALL  SK  I p<  2,  I SK  I P> 

ORDER  HANDLER  FOR  INPUTTING  SUFFICIENT  STATISTICS 

< I *K-  I 

CALL  ORDER! M, K 1 , I NO, NUM) 

C*S/(  AN«-FLOAT(K)*S) 

00*AN«*K 

01*< AS**(K-  ! ) ) * < FLOAT (K  > «S* AN) 

0*<00/01)**rt 

no  200  ./J» !,  i runs 

INPUT  SUFFICIENT  STATISTICS 

CALL  IN(GG, IX<<> 

DO  10  1*1,  N»H 
CALL  IN<  ARR< I > , l X<<) 

CALL  IN<  ABI ( l >, IXXX) 

CALCILATS  L 


I F<  AO.LE.  0* ) AIOAO*!. 
t F( AO.LE. 0. > GO  TO  20 
CALL  BESNIS  (AO,  2,  FI,  PI) 

AIOA0*FI(!> 

CONST*  FLO  AT  ( 1-  I >/(2.*3.  Ul!,)*Al  OAO) 
AOCBO*rtO'*COS(  BO) 

AOSBO* AO«SIN( BO) 

YROMI-3. !ni5R/FL0AT< I) 

XRQ1I--YR0M I 


■ 


CALL  GAUSSHXR0M1/YA0M1/6/AREA) 

C 

AL«  a * EXP! !C/2.)«GG)  * AREA 
C 

C OUTPUT  L 

C 

CALL  OUT ! OL#  I YYY/  I BLOCK  ) 

C 

C END  or  ONE  SIMULATION  SUN 

C 

IF!J./.NE.!JJ/50>«50>  GO  TO  200 
WRITE! 6* 195)  .M 

19  S FORMAT! 2</ ISKRUNS  COMPLETED*/  IS) 

C 

200  CONTINUE 

C 

CALL  OUT! 0./ 250/ I BLOCK ) 


WRITE! 6/ 2 10)  I BLOCK 
FORMAT! /RX/  MI  BLOCK*/  13) 


r? 


t 


? f 

f 

* i 

i 

: \ 


I 

■ 

f 


f 

f 
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II 


C 

c 

I 

5 

7 

10 

30 


.70 


40 

50 

60 


70 


00 

90 

100 

MO 

130 


SUBROUTINE  INPUTS  PARAMETERS  FOR  GAIJS2U 

SUBROUT  INE  PARM2U!  J SKI  P,  N,K,  I RUMS,  S,  AN,  AO,  80) 

WRITECA,  1) 

FORMAT! /3K, 36H8L0CKS  (I  SKIP)  TO  BE  SKIPPED  ON  TAPE/) 

READ!  5,  5)  I SKIP 
FORMAT! I r> 

WRITE! A, 7)  ISKIP 
FORMAT ! /3T,  6HI  SKI  P=,  I 5) 

WRITE! 6, 10) 

FO  RMAT!  /2<,  42HMUMRER  OF  FRSOUENC I ES  <(M>  AND  ELEMENTS  !K)/) 
READ! 5,  20)  M,K 
FORMAT! 212) 

WRITE! 6, 70)  M,K 

FORMAT! /2X, 2RM*, 12, SX, 2HK»,  IP) 

WRITES,  40) 

FORMAT! /2K, 14HNUMRER  OF  RUNS/) 

READ! 5, SO)  IRONS 
FORMAT! IS) 

WRITE! 6, 60)  IRONS 
FORMA'1'!  /2X,  SRRUMS-*,  IS) 

WRITE!  6.  70) 

FORMAT! /2T, 34 MPOWERS  OF  SIGNAL  !S)  AND  NOISE  CN)/) 

READ! S, HO)  S.  AN 
FORMAT! 2FS.2) 

WRITE! 6, 90)  S,  AN 

FORMAT!  /2X»  2HSa,  F5, 2,  5'<,  2HN»,  FS  .2) 

WRITE! A.  100) 

FORMAT! /2<.7PKUNC&RrAlNTY  PARAMETERS  AO  AMO  90/) 

READ! S,  I 1 0)  AO,  80 
F0R1AT! 2FS. 2) 

WRITE<6, 120)  AO,  80 

FORMAT! /2<, 3HA0*, F5.2, 5X,  3480= , F5.2) 

RETURV 

END 


3 


FUNCTION  CALLED  BY  GAD AS  1 ID  PROGRAM  GAUS2U 


FUNCTION  GI(WOTS) 

DIMENSION  JM < JO> 

COMMON  XU250).  X2<250).  IND(  100)  > ABAC  100).  ABIUOO). 
1 C.  AI OAO..  CONST.  AOCBO.  AOSBO,  M,  NUN 

SS»0. 


DO  10  I*!* MOM 

ARG3  FLOAT (INQ<I)-1)  * WOTS 

SS3  SS  + ABR<  I >*COS(  ARG)  - ABU  I ) *S INC  ARG) 

SS»C*SS  ♦ A0C80*CQS(  FLOAT <M-  I )*WOTS>  - AOSBO*SIN<  FLOATIM-  1 ) *WCTS) 


G1=C0NST*EXP(SS> 

RETURN 

END 


<r>  o r>  n n nnnoooocjno 


■ 175 


SIGNAL  XNOVN  EXCE°T  FOR  DIRECT  I OH 
IN  NOISE  OF  HNOVN  DIRECTION 
PART  I 

$ A OTFI  I/0TF3  2 

PROGRAM  CALLS  SUBROUTINES  IN,  OUT,  PARA-JO*  ORDER,  AND  SHIP 


INITIALISING 

REAL  !LR>  ILl,  NVOTN 

DIMENSION  SR<  10)*  S I ( 10)*  I HOC  t 00)  * A8RII0,I0>,  ARIIIOdO), 
t AAR  1<  100),  AAIKIOO) 

COMMON  XII2S0),  X2I250) 

I XXX* 25  1 

IYYY*1 

IRLOCX’-O 


IN  POT  °AR  A -JETERS 

CALL  PARAMO! I SXt  P,  <1,4,  t RONS,  ES,  A.N,  0) 

IFUS4IP.NE.0)  CALL  SKI  P<  I,  I SXI  P) 

OROER  HANDLER  FOR  OUTPUTTING  SUFFICIENT  STATISTICS 
Kt*K~l 

CALL  OROER<-<J,K  I,  INO,  MIM) 

C 

WRITE!*,  10) 

10  FORMAT! /2X,  MHRUVS  COMPLETED/) 

00  800  .J.J*  I,  IRONS 

a 

C A SINGLE  FREQUENCY  SIGNAL  IS  ASSUMED 

C 

C SINGLE  FREQUENCY  CONDITIONAL  SOLUTION 

C 

C GENERATE  FOURIER  COEFFICIENTS  UNDER  HO 

C 

Nt./0TN»3. 1A  ISO/2. 

A0R*SQRT!ES/2.) 

HOI *0» 

CN*  SORT ( AN/2« ) 

CO*  SORT  ( D/2» ) 

CALL  INI YOR, I XXX) 

CALL  I >N( YDt , 1 XXX) 

DO  100  I*I,K 
ARG=FLO AT  1 1 - l XNUOTN 
OS*  COS ( ARG) 

SN*  SINIARG) 

CALL  INIYNR, IXXX) 

^ R! I > * CW*YNR  + CD*  f YDR*CS  + YOI*SN) 

CALL  I N< YNI , I XXX) 

100  El  ID*  CN* YNI  + CO*IYO!«CS  - YOR*SN> 
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C 

C 

C 


C 

0 

C 


190 


no 

o 

c 

c 


160 


170 

C 

c 

0 


[j 


no 


‘SUFFICIENT  STATISTICS  INDEPENDENT  OF  TS 


C * 
Ola 
* < 
09= 
G3* 
DO 
ARC 
03* 
- Z 
03* 
G 


0 / (AN  * (AN  FLOAT  ( X ) * Q)  ) 

- ( ( FLO  AT  < X ) * ( AN  ♦ FLO  AT  (K-  1 > -k  0 ) > / ( AN*  ( AN  ♦ FLOAT(X)*D> ) ) 
AOR*ROR  ♦ UOI*F?Ol) 

(9. /AN'  * (?R(t)«ROR  ♦ Zl(l)*30I> 

0. 

110  I * 1 » K 

FLOAT < I - 1 ) * NWOTN 
G3  ♦ (ER(l)*ROR  * *1(1 >*BOI >*COS(ARG>  ♦ (£R(I)*BOl 
l ( t )*UOR)«SIN( ARG) 
g.«C*G3  . ‘ 

01  V G9  - G3 


LI 

i 

L 


SfJFFICI  ENT  STATISTICS  DEPENDENT  ON  TS 


DO  130  L= 1 
L 1*  L+l 
GLPa  (l./AN) 
OLI  a (l./AN) 


XI 


(XR(L 1) <ROR  ♦ 
(/.R(L»)*BOI  - 


7,  l (LI)  *001) 
/.I  (L  l )*30R) 


KLR*0. 

HL1 =0. 

DO  190  t*>,X 

ARG=  FLO  AT < I ~L  I ) * NWOTN 

MLR*  MLR  * (7.R(I)«B0R  * f.  1 (I  ) « HOI  ) *Cl)S  ( ARG) 

- Em>*RO!t)«SIW(ARG> 

ILI*  MLI  *•  (XR(I)«ROI  - '.ia>*EOR>*OOS(A«G> 

- (ER(f)«ROR  ♦ ^1(1  )*F?OI  ) • SIN(  ARG) 

HL°a  C«HLR 

HLI a C*HLt 


► ( £R(  I >*  ROI 


KL*K-L 

ARG*  FLOAT(L)  « NWOTN 

CtL=  C « FLO  AT  (XL)  - (ROR-OOR  «■  R0I«30I) 
ILPa  OIL  « COS(ARG) 

ILI a CIL  * SIN(ARG) 


A‘WLL)=  GLR  - MLR  * ti.R 
ARt<4»r.>*  -OLI  * MU  - ILI 


CON  SINE  SINGLE  FREOUENCY  SOLUTIONS 


100 


DO  SoO  I * 1 j 
APR  I ( l ) *0. 

ARI  HI  >a(). 

DO  170  (.a  t > >C  1 
INDEX*  (1-l)*L  ♦ I 
ARRK  INDEX)*  AMR  HINDER) 
AHI  HINDER)*  AMI  1 ( INDEX) 


A0R(-1/L) 
API ( M,L) 


OUTPUT 


cv/t  r&z. 


t 

i 
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| 

CALL  0MT<0,  IYYY,  IBLOC-O 

00  10  0 1=  tx'JlM 
• 1^* I M0<  t> 

CALL  OUT  ( APS  1 (•! ) > IYYY,  IMLOCK) 

!<J0  CALL  0UT<A0l  l(.J>>IYYY*IML0C-O 

C 

C FMU  OF  ONS  M -tULATlOM  Oil) 

C 

1 F(-/-J  .MF»  f ' ‘ / \ 00)  * t 00)  GO  TO  200 

tltTr;'.  J>>5)  . 

19  S FO^iAT < 2Xj  16) 

C 

200  CONTINUE 

CALL  OUT  C0*<250<  I ULOCK  ) 

Wtl  TSX6j  210)  tOLOCX 
210  F0ct'JAT(/2X,  7HIBL0C»<  = » 13) 

STOP 

X CUD 


l<£2tz . 


* • ,«|V  ^ •*' 


XOSi 
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0 SUBROUTINE  EN°UTS  PARAMETERS  FOR  S.XEDI 

C 

SUBRCUT  | Mg  PAR  AM  3 < I SK I p,  M,  < , l ROMS,  ES,  AM,  D) 

WRITS? 6, 1 ) 

1 FOR  MAT?  /8X#  36HRL0CXS  US.MIP)  TO  BE  SHIPPED  ON  TAPE/) 

RSAO?  5,  3)  I SKIP 

S FORMAT? I 5) 

WRITS(ft,7)  ISXIP 

7 FORMAT? /EX, 6HI SKI P*, I 5) 

WRITE? 6, I 0) 

10  FORMAT? /EX, AEMNUMRSR  OF  FREQUENCIES  ?<M)  AMD  ELEMENTS  ?<?)/) 
READ?  5, E0>  M,  X 

EO  FORMAT? EJ  E) 

WRITS?6>30)  M,  K 

30  FORMAT? /EX, EHM3, 1 3, 5X,EHX», 18) 

WRITE?6, AO) 

40  FORMAT? /EX, 1AUNUMBER  OF  RUMS/) 

READ? S, SO)  IRUMS 

SO  FORMAT? IS) 

WRITE? 6, 60)  I RUNS 

60 ‘ FORMAT? /EX, SHRUNS*, 15) 

WRI TE?  6, 70) 

70  FORMAT ? /EX, A IrfPOWERS  OF  SIGNAL  ?ES)  AND  NOISE  ?N  AND  0)/) 

READ?  5,  AO)  SS,  AM,  O 

SO  FORMAT?  3FS.  8) 

WRITE? 6,00)  ES,  AN,  0 

AO  FORMAT? /EX, 3HES*,  F5 . 8, 5X, EHN=  , F5.8, 5X, 8HD=, F5.2) 

RETURN 

END 


0 

1! 


i, 
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SIGNAL  KNOWN  EXCEPT  POT  DIRECTION 
IN  NOISE  OP  KNOWN  DIRECTION 
PART  II 

SA  OTP  t I /OTP 2 2 

PROGRAM  CALLS  SUBROUTINES  IN*  OUT#  PAHA-14#  ORDER#  SKIP# 
8ESNIS#  RO-II#  FG2U 


INITI ALIEING 

DIMENSION  PI  ISO)#  PK200),  AI20#20) 

COMMON  XII2S0)#  X2I2S0)#  INDI100)#  ABRCIOO)#  ABICIOO)# 
1 C#  AIOAO#  CONST#  AOCBO,  AOSBO#  -M#  NU(M 
IXXX*2S! 

IYYY» I 
I BLOCK3  0 

INPUT  PARAMETERS 

CALL  °ARAM4 1 1 OKI °# M#K# I RUNS#  AO#  80) 

I F( I SKI °.NS«  0)  CALL  SKI °I2# I. SKI P) 

ORDER  HANDLER  TOR  INPUTTING  SUFFICIENT  STATISTICS 
K1*K-I 

CALL  OROER(M#KI»IND#NU.M> 


WRl 1 E<  S#  S) 

F0RMATI/2X#  UHRUNS  COMPLETED/) 
DO  200  J.J*  1,  I RUNS 

INPUT  SUFFICIENT  STATISTICS 

CALL  I N I G#  I XXX) 

00  ID  I=>1#NUM 
CALL  INI 4RR< 1 ), I XXX) 

CALL  INI ARI II )# IXXX) 

CALCULATE  L 


UNCERTAIN  DIRECTION 

IFIAO.LE.O.)  AIOAO* I. 

IFIA0>LE.0.)  GO  TO  '20 
CALL  BESNISIA0#2#FI#PI) 

AI 0A0*FI I 1) 

CONST=*FLOATIM-  l)/I2.*3.  14 I59«AI0A0) 
A'",CRO"»AO*COSI  PD) 

AOS80*A0*SINt 80) 

YR0MI=3. 54 IS9/FL0ATIM- I ) 


MHfj’JBM&atiH'Oi&fe flJ 
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C SUBROUTINE  INPUTS  PARAMETERS  FOR  SXEDRIJ 

C 

SURROUTtNE  PARAM4!  IS,!iP,-M,.<>IRUNS>  AO,  90 
WRt  TE! 6,  I) 

I FORMAT! /J>X,.0<SHRL0!XS  USXIP)  TO  BE  SXIPPEO  ON  TAPE/) 

REAOIS, 5)  I SKIP 
S FORMAT! I 5) 

WRITE! 0,7)  ISXIP 
7 FOR  MAT ! /2X,  6HI  SX I p*,  15) 

VRITE!S,  10) 

10  FORMAT!  /RX,42UNUMBER  OF  FREQUENCIES  ID  AND  ELEMENTS  !*<>/> 

READ! S>  20)  M,K 
20  FORMAT! RIR) 

WRITE!  S,  001  *M,K 

00  FORMAT!  /2X,  3RM*,  I 2,  SX,2HX*, 12) 

WRITE!  6,  AO) 

40  FORMAT! /2X, I4HNUMBER  OF  RUNS/) 

REAR! S. SO)  IRONS 
SO  FORMATUS) 

WRITE!  A,  60)  I RUNS 
00  FORMAT!  /2X»  SHRUNSa,  I 5) 

WRITE!  S,  100) 

100  FORMAT!  /2X»  32HUNCERTAINTY  PA°  ‘>  METERS  AO  AND  30/) 

READ!  S,  HO)  AO,  90 
110  FORMAT! RFS.R) 

WRITE! A, 120)  AO,  BO 

120  FORMAT! /RX, OHAO*, FS. 2, SX, 3UB0*, F5.2) 

RETURN 

END 


I 
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SUBROUTINE  ROM t < X, Y, A. I > 

THIS  SUBROUTINE  FORMS  THE  INTEGRAL  OF  GICP)  FROM  X TO  Y 
THE  ANSWER  IS  RETURNED  IN  A(I,l> 

PRO GRAN  NEEDS  FUNCTION  GI(P) 

DIMENSION  A(20>  20) 

N=f>  0 

AC  l*  I>3CGKX>*G!(Y>>*CY-y>/2. 

DO  3 I32,N 

RECUR  I 

SUM30. 

IK32«*< I- I )- | 

DO  1 J=*I,IK,2 
A-ja.I 

SUM3 SUM >G I <X*((Y-X)/C2.*«(I» 1)))*AJ> 

AC  I > l ) = . S * < AC  1 ~ 1j  l)*CCY-X>/C2.««CI-2)>  ) «SIJM> 

EXTRA I 

It3I-l 
DO  2 1 » I I 

A(I,K*  1>-C  CA.*«-<)  *AC  !,*<>- AC  I - 1/  <>  > /C  $.**■<-  1 .) 


IF( ARSC  AC l # I)-AC I- I» I- l > )- . IE-02)  5, 3,3 

CONTINUE 

WRITE! 6. A) 

FORMAT < / /2X, A6HWARNING  « INTEGRAL  1 REOUI RED  20  ITERATIONS  * > 

RETURN 

END 


-*  ti  J , 


f V^ Wy£ .‘  T^jy'. **»  iJj’JiC}*'***  Vo\i>  3>.J  ' ? /--- ' 'x-'‘V  t-^'^V  /"  *>  «*•■  ,-•>.**.**»■ 


i , g JJ  * '=■  IU  >IIJ  »m£ 
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Signal  Known  Exactly  in  Noise  with  an  Additive  Directional 
Noise  Component  of  Uncertain  Direction  (SKE  in  NUD) 


* i 


(See  SKED  in  NKD  Section  for  "SUBROUTINE  PARAM4";  random  numbers  uniformly 
distributed  between  zero  and  one  are  read  from  DECtape  by  "SUBROUTINE  IN3") 


m 


o o o n o o — n n n n rj  n o a a n n n n r»  no 


Trr’TTZ 


g^5SS£^BBWB!BlgS^^ 


■ --«e*a 1 j HUH?' 
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1 


1 

♦ £ 


SIGNAL  KNOW M EXACTLY  IN  NOISE  WITH  A DIRECTIONAL 
.401 SE  C04°0NENT  OF  UNCERTAIN  DIRECTION 


PART  I (STRUCTURED  FOR  A C4AIN) 

S A OTF 1 1/OTFR  R/0TF3  3 

PROGRAM  CALLS  SUBROUTINES:  14, OUT, I N3, PARA  15,  ORDER,  AND  SXIP 

INITIALISING 

REAL  NNOTS,  NWOTN 

C0440N  X 1 ( R50)  , XECR50),  X3CRSO),  SRC  10)/  SIC  10),  INDCJOO), 

1 ARROC  10/  10)/  ARIOCIO/IO)/  AURIC  10, 10),  A!»I  I < I 0/  ! 0) / 

R GC 10)/  ARR40C  t 00) / ABI.40C100),  ABB  4 1 < I 00)/  A3I4IC100) 

I XXX*R5 I 
I YYY=* 1 
IRLOC-C^O 
IXX3=R51 
SQT*  SORTC  2«  > 

INPUT  QARA4ETERS 

CALL  OA'-»ANSCtSXtP,-1,X,  IRONS, RS,  AN,l„A0,«0> 

I F(  I S-CI  P..4E/0)  CALL  SXIPC  l,IS<I*>> 

OROER  HANDLER  FOR  OUT PUTTING  SUFFICIENT  STATISTICS 
XI*X-I 

CALL  0 BOER  CM/  <1/1  'll)/ NUN) 

UR I TEC  S,  10) 

F0R4AtC/RX,  1AKRUNS  CON DLETEO/ ) 

00  ROO  •)•/=  1 / I RUNS 

CKOOSE  A RAN004  NOISE  DIRECTION 

CALL  P0SC4U0TN,  AO,  IXX3) 

W0TN=NU0T4/FL0AT( 4- | ) 

A SINGLE  FREQUENCY  SIGNAL  IS  ASSUiEO  AT  ( 4-  1 > *Wl)=NWO 

NNOTS -3. I A 159/2. 
qOR=SART( ES/R. ) 

BO I *f,. 

CN=  SORT  C VN/R. ) 

cn=  sortc  i'/r  • ) 

C 1=  C AN ► FL 0 AT C X •*  1 ) *0) /(  A J*(  A -U- ^LOAT  ( X > «0>  ) 

CR^D/  ( AM«  C AN*  FLOAT  ( X l^D)  ) 


00  f B 1 NM*  1 , >f 


7*>  i'-3&'  y i I 


7 mi 


| . ■ i , .;V%s| 

I-  • • +.*  > i*Yi 

V r-..0V*'*'l 

• ?:-V''ia 1.1 
« . ..  » * 

_ ' •:,//'  ?,,  . A . ■ ■•  *■» 

I jb  ’ * •*/  :,  &'  ,Y<:  ‘ , w 

I v.cvvvg 
| v * 

' 

I ; &1W 
T >..  .-aw-v-v** 

£<•  ' • • F#'\*  ;j 


• mi 


O^yecj^-.v  fOIHIFR  COEFFICIENTS  1JNDCH  HO 
CA  L GENC  IXOO-v/'M..  VOTN,SQT.»CN»CD) 

cuff.”  ,;.: r ".•atistics  independent  of  tn 

GUI.  VI?  I roi  { M si , o l * M*  MWOT  S,  HOB , GQ£  * K > Q J > G9  ) 
, jfENT  STATISTICS  DEPENDENT  ON  TN  ’ 
CALI  r.i  FDTM  <K  ijHjVvi/ 1..  L*  MV  07  S*  BOH*  B0I>C2) 


i,.^1tWE 


C.‘  *?BINC  c :MGL  . FREWEMCY  SOLUTIONS 


, riL i , ; • .i  1 > G2>  ijT>  GG*  At  -I  I ) 


OfJT  PUT 


CALL  OUTPUV(G3/GG>MU'l>  I YYT*  I BLOCK) 

END  r>*  n«r  MMIILATION  HUM 

IF<.J.J.NE.<U.i/IOO)«IOO)  GO  TO  200 
NHl TE(  fa  195  > J.J  . 

~0RMAT<2X,  15) 


CONTINUE 

call  OUT<  0*  * <?SOi I BLOCK) 
WHt  TE( 6/210)  I BLOCK 
F0rMAT(/?X, 7H I BLOCK*, 15) 
STOP 
END 


I*  f - ~ W- 


'Tt « i’/teawry-  ‘ 


c 

c 


l 

s 

7 
10 
80 
10 
40 
SO 
60 
70 
00 
00 
100 
I 10 
190 


1 


186 


SMARO'iriNE  INPUTS  PARAMETERS  FOR  SKEC01 


srjBRO'IT 
WAITE!  <S 
FORMAT ( 
READ!  S. 
FORMAT! 
NR1TEC A 
FORMAT  < 
WRITE!  6 
FORMAT! 
READ!  S, 
FORMAT! 
VIITEtfi 
FORMAT! 

VAITE(6 

FO  A M AT  ( 
READ! 5, 
FOAM AT ( 
W=itTE!S 
FO AMAT ( 
W9IT-:<6 
FOAM AT ( 
READ!  S, 
FOAM AT < 

wr;te!A 

FOAM AT < 
WRITE! 0 
FOAM AT ! 
READ!  S, 
FORMAT! 
WAITS! 6 
FORMAT! 
RETORN 
END 


INK  OAPAMK  I SMI  P,  M,  <,  l RONS,  ES,  AN,  I),  AO,  00) 

, 1 ) 

/8X, 36HAL0CKS  ! ISM  IP)  TO  OE  SKIPPED  ON  TAPE/) 

S>  ISM  IP 
IS) 

7)  I S<I  P 
/8X, 6HI SKI P=, IS) 

10) 

/8X» 48HN0MREM  OF  FREOOENCIES  ( M)  AND  EL  El  ENTS  <•<)/> 
80)  M,  K 
818) 

,30)  (M,  K 

/8X, 80Ma  » I 8, SX, 8HKa, 18) 

.4  0) 

/8X,  14KNUMBER  OF  RUNS/) 

SO)  I RIJNS 
IS) 

,60)  IRONS 
/8X.  SKA1  INS*,  IS) 

70) 

/8X, 4 1HP0WEAS  OF  SIGNAL  CES)  AND  NOISE  (N  AND  0>/> 
MO)  ES,  AN,  D 
.3  F S ♦ 8 ) 

,7  0;  ES,  AN,  D 

/8X,  3HES-,  FS.8,  SX,  8HN=, F5.8, SX, 840=, F5.2) 

100) 

/RX,  384DNCKRTAINTY  PARAMETERS  AO  AND  80/> 

I 1 0)  AO,  AO 

8 FS.8) 

, 180)  AO,  AO 

/8X.3MA0-,  FS.8, SX,  3HH0=, FS.8) 


, L „ - rfr*  aaa> 


i.'  -»*■*» 


SOOBOHTINE  CHOOSES  A BANDOB  NOISE  1)1  SECT I ON 


SifBBOUTtNE  CALLS  SiJBHOOTINE  IN3 
tA  0TE3  3 

SORAOIfTINE  °OSCNVOTN,  A0»  ***3) 
SEAL  NWOTK 

OI-1ENSION  AC25),  BC25) 

CO-HON  XI  C2S0).  X2C250),  X3C250) 


A( I >*.0006 
AC2)3.0290 
AC3)3.OA05 
AC A) ». 0680 
AC5>=<  0677 
AC6)3. 1077 
AC7>3. 1260 
AC  6 > 3 • 1366 
AC9)*. 1696 
A<  I A)  a.  |9  1/4 
A<  1 I)*.3n6 
A< 12>  = . 3363 
AC  13)3. 2607 
AC !A>3 .2656 
AC  I 5>*. 3 1 21 
AC  16)*. 3 A 00 
AC  17)3. 3700 
AC  l A) 3 . A 093 
AC  19 ) 3 . A 370 
AC 20)*. A 7 76 
AC  2 1 >*. 5230 
AC  22) 3 . 6772 
AC23)*.6A6S 
AC2A ) 3 . 7A  3 I 
AC26)3.93 17 


12a: 


BC 1 >3. 
BC  2) 3 . 
B C 3 ) 3 « 
AC  A ) 3 . 
ACS)*. 
3C6)=. 
B<7>3. 
BC6)3,. 
B C 9 ) 3 ^ 

B C I 0 ) 3 
BC  ID* 
BC  ! 2) 3 
B ( I 3 > 3 
BC I A)3 
BC  IS>=> 
BC 16>3 
I3C  I 7)  3 


0163 
0AS9 
0766 
1076 
I 36  7 
170} 
2026 
2353 
9669 
. 3033 
.3391 
.3  760 
. A I AA 
♦ 4 5A6 
« A-)  75 
. 5 A 29 
.5913 


iyiB|^r'TOiiT^r.  y^v.T^jwgaaiaa^ggiJ^ 


H< 13>*. 6450 
PH  l*>>  = . 7033 
3(20)=. 77041 
30?  I > = .34|7<j 
3(4>!?>s  .')  <t  | | 

3(53) a J . 0 630 

no? 41)=  s .24125 
3<25>= I .6350 

0 

CALL  IM7<Y, IXX3) 

•J3I*)T  < ‘jO.-nY)*  1 

IFM.GT.S0>  .j=SO 

I F<  AO. FO. 0. > MVOT.\J=  6. 333  I 3*  C Y- . 5) 

jpxao.fq.o.)  go  to  io 

1FC.J.GT.33)  00  TO  S 
IF(A0.FQ.7.)  NV0T3=AM> 
1F<A0.F0.3.>  NWOTM-*P)(.J> 

GO  TO  10 

S J=*.|-2<5 

l PX AO. FO. 7. ) :MWOT.V=-A<-/) 

IF<  A0.F0.-3.)  MWOTaJ=-AM) 
iO  AFT'RN 

FNO 


•nrtaeaiSKSSStSlSe^b, 


188 


■'  l 

U 


i 


190 


SORROW  I NS  GSV<  IXXX,K,  A4,  VOTM,  SOT,  CM,  CO) 


■ ,ir,00>' 

' Qt,0>-‘  ABRKO(IOO)#  ARI'-IO(  100),  AORKKIOO),  A9HKI00) 

GENERIS  FOORIER  COEFFICIENTS  UNDER  HO 

CALL  IN<YOR, IXKX) 

CALL  IM<YOI,IXXX> 

DO  IOO  Is  UK 

ARG*FL0 AT ( I - 1 > *FL0AT<  MM-  I )*WQTN 
CSsCOS<ARG> 

SN*SIN(ARG> 

CALL  IN(YNR>  l XXX) 

^ R( I ) aCN*YNR  + CD«<YDR*CS  + YDI#SN> 

IF<MM.E0.|>  ^RCDaSOTti-SRCI) 

CALL  IN<YNl,lXXX> 

E I < I ) sCN*YN  I * CD*<YDI*CS  - YDR#SN>  ' 

IFCKM.EO.l)  EUn'sO. 

R STORM 
SMO 


SUBROUTINE  SUE! TN < >!•),  C I > i>  NWOTS,  GOG,  BOI/.<>  Gl*  GSJ) 

BEAL  NVOTS 

CO"HON  X!(2S0)j  Xq(9SO>>  X3<ESO)>  'IK  10)*  £I(IO)>  IN'X  1 00)  , 
I ARROC  | 0,  I 0)  • AGt 0(10*  10)*  RUB  I ( I 0»  1 0) , A4I1(10*10>* 

9 G(,0>'  AUR1.'<  !00>,  ARI'!O(|00>*  AGA41UOO),  AOMKIOO) 

SUFFICIENT  STATISTICS  I 'JOE  PEN  RENT  OF  TN 

OINNJaO. 
r"l  II  0 t = I * K 

GC'H)*r,(NM>  * 7.R(  I ) *7,R{  I ) ♦ /,i(D«/4(i)  / 

il(MM)  = -C  I «GC,'M) 

I FC-H.NE.  -I)  GO  TO  130 
G 1 3 0 . 

00  |qo  l 3 1 / r( 

ARGa FLOAT  <1-1 >*NWOTS 

G I =* G 1 </.R(I)«BOR  + '.I(I>*R0l>  « COS(ARG) 

I + (ER(I)«RQt  - ^ I ( I ) « SOB)  « SIN(ARG) 

G|aq.«(:  i * G t 

GE3  -float (K)*ci*( oor* dor  ooi*boi> 

CONTINUE 


RETURN 

ENO 


' ''"  "W!| 


II ' 


192 


o 


. SUBROUTINE  SUFOTNIKU-O-M^LiNWOTS^Oh,  B0l,G9> 


0 

0 

0 


C 


140 

0 


C 


1*50 


C 


160 


c 


c 

170 


BEAL  NWOTS 

OOHMOM  X I < 250)  > X2(9S0),  X3(2S0>,  £«<10),  /.I(10>,  INI)(IOO>, 

1 AB90(10,  10),  A91 0(  10,  10),  AG9 1 ( 1 0>  I 0) , 4RI 1(10,10), 

2 6(10),  499X0(100),  A9H0C  100),  A99X1CI00),  ABI"51<100> 

SUFFIOI  ENT  STATISTICS  DEPENDENT  ON  TN 

DO  180  L*1,X1 

CL9*0. 

CLI*0. 

KL*X-L 

DO  140  l*i, KL 
IL*!*L 

CL9-CL9  ♦ WUX/.RUL)  ♦ /.KDV.UIL) 

CLI*CLI  ♦ E9(l)*EI(IL)  - 2t<I)«£R<IL) 

0L'\-*  Oi 

0Li*0. 

EL9»0. 

ELI *0. 

FL9*0» 

Fl,l*0. 

IFi'H.UEX)  GO  TO  170 

L1M*L-I 
DO  ISO  I* l, XL 
49G»KL0aT( I*L M)*NWOTS 
DL9*DL0  ■*•  (£9(1) *909  ♦ £1(1 >*901) 

I * (£9(I)«B0l  - EKIXBOR) 

0LI*0L1  *■  (E9(!)*B0I  - £I(I>*909) 

I *>  (7,9(1)1.909  *•  £I(I)*BOI) 

L l P*L* i 

DO  160  I =L  l p,  K 
r,9G*FLG4T(  I -L  J °)  «>JVOTS 
EL 9* EL 9 «■  ( E9<  I ) * 009  + £1(1 >*901) 

1 ► (7,9(1X1)01  - EKIXHOR) 

EL! *ELI  ♦ (E9( I )*BOl  - £I(t)«KOR> 

1 - (£9(1)*  909  ♦ £1(1) *40! ) 

A9G*FL04T(L)«.'JU0TS 
0‘L*FL0AT(‘<L)*(  909*909  + HOI *001) 

FLR=»CFL*C0S(A9G) 

FLI*  -CFL*StN(A9G>  ‘ 

CONTINUE 

AHPK'I^L)*  2.«C2*(0L9-0L9-EL9*-Fi.,R> 

A9I  1?M'1,L)3  a.*Ca*‘(OLI-  DLI  + ELI  ♦•FLI  ) 


« OOS(ARG) 
« SINIARG) 
« C0S(A9G> 
* SIN(rtRU) 


* C0.S(A9G> 

* SIN(a90) 

* COS ( A9G) 

* SIN(ARG) 


0 

0 

0 

0 


i 


i 

1 


S? 


l .*.Vh»^  '.-■'l'  . 


■ <?C5  - - **?*•,  tv  - . - W*.^  w*?w«rr**«*si:^^ 


9.*C'-?«CLS 

MO  W0(H,L)3  5?»'*Ci?«Cl.i 
C 

S^T'I'W 

i^MO 


" J^5^^i"*''*'  *® <r**^ 
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I 


< 

1 

I 


j 

i 


i 

| 

s 

\ 


fW* 
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sorrootine  ccwntGij  r,?,  no.  gG/^x  »> 

COXNON  X 1 ( 2*50)  > X2<2*S0>,  Xl(f>50)>  XR<10>,  XUIU),  IND(IOO), 

1 AAROC  t Oj  i i?)  i ABI‘0(  I Oj  1 0)  » AORKIO,  !0>,  A01UI0,  10), 

2 fi<10>,  ABR40C  I 00)  , ARI  10<  I 00)  • AB‘M  1(100),  AO I 4 I < 1 00) 


COMBINE  SINGLE  FREONRMCY'  SOLUTIONS 

00  182  t--<  1,  100 

AHRN  1 (!)  » 0* 

ARIitCD^O. 

ABRMO<  I)»0* 

ARI10C  I ) = o« 


G3=0. 

no  182  MN*I,N 

G.1*G3  * GINN) 

GG=»G  1 «•  G2 
00  185  -H=  l,M 
00  184  L*|,Ki 
INOEX*  <-H-l)«L  «■  I 

ABRNKINnEX^ABRNICINOEX)  * A6R  1 C 44>L) 
ABHKfNDEX)*ABI<ll<  INDEX)  ♦ AOIUX-I.L) 
ARR40<Ir'nB<):*4BR4Q<  INOEX)  * A0R0M1,L) 
AOI  lOt  IN0EX)  = 4RM0<  INDEX)  ABIO<-H,L> 
CONTINUE 


RETURN 


1.5 


SUBROUTINE  OUTPUT(G3,  GG,N;.M, I YYY,  I BLOCK) 

COMMON  X ! ( J?  *>  0 > # XK2SO),  X3(2S0),  - (10)/  ZK10)/  I NIK  100)/ 

1 ftW(|i)/IO),  AS  I 0<  10/  10)/  ASS  1 ( 10/  10)/  AAIKIO,  10), 

2 G(  I 0)  / AOOKO<100>,  AOI-MK  100),  A3R  -I  1 < t 00)  , ABI.-i  l ( I 00) 

OUTPUT 

CALL  0UT<G3, IYYY, IOLOCK) 

CALL  OUT(GG, IYYY, I ALOCK) 

00  190  I»1,NU1 
•J=»IMD< 1 ) 

CALL  OUT ( AS9K 1 ( I) , 1 YYY/ I SLOCK / 

CALL  OUT  ( ABI  lUJ),  I YYY,  1 SLOCK) 

CALL  OUIK  ASSMOM),  I YYY,  1 PLOC-O 
CALL  OUT(  A.AIKO(J),  I YYY,  I BLOCK ) 

RETURN 


’*X* 
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SIGNAL  KNOWN  EXACTLY  IN  NOISE  WITH  A DIRECTIONAL 
NOISE  COMPONENT  OF  UNCERTAI  N DIRECTION 


PART  II 

«A  DTE  i l/.OTFR  2 
PROGRAM  CALLS  SUDR0U7 I NKSs 
GAUSS  1 , GAUSSR,  Gl<  GR 


I N,  OUT,  PARAM4,  ORDER/  SKIP,  OESNI  S, 


INITIALIZING 

DIMENSION  FI  ( 50) , PKROO),  A(20,R0>,  XC4),  Y<4) 

CO-IMON  X 1 ( 2S0) , X2<250),  IND(IOO),  AORMO(IOO),  ABHOCIOO), 
ADRM 1 < 1 00) , ABIMKIOO),  C,  Al  OAO,  CONST,  AOCBO,  AOS  GO,  rt,N>H 
IXXX’RSl 
IYYY’  l 
I BLOCK’D 

INPUT  PARAMETERS 

CALL  PARA  M ( I SKI  Pi.  M,  K,  I PUNS,  AO,  R0> 

IFdSKI  P.  ,-;.0)  CALL  SK!  OCR,  I SKIP) 

ORDER  HANDLER  FOR  INPUTTING  SUFFICIENT  STATISTICS 
Kt’K-I 

CALL  ORDER! M, K I , IND,NUM) 


C’  I . 

IFCAO.LE.O.)  AIOAO’l. 

IF<AO.LE.O.)  GO  TO  RO 
CALL  BESNISCAO, R, FI, PI) 

AI AAO’FI ( I > 

CON  ST’ FLO  AT  <M-  !)/(R.*R.  I A 1 50*  Al  OAO 
A DC BO’ AO* CO  S ( DO) 

AOSRD’AD*SIN(BO) 

YRONl’1.  I A 1 SR /FLO AT ( M- 1 ) 

XRO-f  I’-YROM  I 
<<  D’XROMI 
X(R)’XRO-f  I/R. 

XO>  = 0. 

X</|)’YR0M  l/R. 

Y(  l)’X(R) 

Y(R)’XC3) 

Y(.D’XCA) 

YCA)’YR0M 1 

'•'RITE! 6,  S) 

FORMAT! /RX,  IAHRUNS  COMPLETED/) 

DO  ROO  .J.J=  I,  IRONS 


IN°UT  SUFFICIENT  STATISTICS 

CALL  INIG-I, I XXX) 

CALL  INIGG>IXXX) 

CO  10  I=*|>NUN 

CALL  INI ABRX1 1 1 )« I XXX) 

CALL  INIARl-Xltt), IXXX> 

CALL  INtABRMOII),lXXX> 

CALL  INIA9IX0II), IXXX) 

CALCULATE  L 

ANUX»0. 

A0EN0X=*0. 

00  15  I=>1,4 

CALL  GAUSSl{Xa>,r<I>,6.AREA> 
ANUX* ANUN*  AR EA 
no  17  I»|, A 

CALL  GAUSS2IX! I )>  YI I > .»  5, AREA) 
ADENOMA  AOENOX*-  AREA 

AL=*  EXPIGG)  • ANUX/AOSNOX 
OUTPUT  L 

CALL  OUTIAL, IYYY, I BLOCK) 

GNO  OF  ONE  SIXIJLATION  RUN 

I FC.IJ.NE.  I.JJ/50)*50>  GO  TO  POO 
WRITE! 6*  195)  .JJ 
FORXATI 2X» 15) 

CONTINUE 

CALL  0»JTI0.>5>50>  I BLOCK) 
HRITE<6> 210)  I BLOCK 
FORK ATI /2X>  7HI BLOCK*, 13) 

STOP 

END 


r * l ‘ 
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SUBROUTINE  GAUSS1(X,Y,M,  AREA) 

SUBROUTINE  GAUSS  USES  THE  .M-POl.NT  GAUSS-LEGENORE  QUADRATURE 
FORMULA  TO  COMPUTE  TKE  INTEGRAL  OF  Gl(X>*OX  BETWEEN 
INTEGRATION  LIMITS  X AND  Y.  TKE  ROOTS  OF  SEVEN  LEGEND 

R 

POLYNOMIALS  AND  TKE  WEIGHT  FACTORS  FOR  THE  CORRESPONDING 
CUADRATURES  A»E  STORED  tM  THE  Z AND  WEIGHT  ARRAYS 
RESPECTIVELY.  M MAY  ASSUME  VALUES  2,3,4, 5,6,  1<J,  AND  15 
ONLY.  TKE  APPROPRIATE  VALUES  FOR  THE  rf- POINT  FORMULA  ARE 
LOCATED  IN  El.  EM  ENTS  ZCKCYCl),  ...  , 2 ( <EY( 1+ I ) - 1 ) AND 
WEI GHTCXEY! 1 ) ) , ...  , WEI GHTCMEYC 1+ l ) - I ) WHERE  THE  PROpER 
VALUE  OF  I IS  DETERMINED  SY  FINDING  THE  SUBSCRIPT  OF  THE 
ELEMENT  OF  THE  ARRAY  NPOINT  WHICH  HAS  THE  VALUE  rf.  IF  AN 
INVALID  VALUE  OF  -M  IS  USED/  A TRUE  ZERO  IS  RETURNED  AS  THE 
VALUE  OF  GAUSS. 


(IS)> 


(20), 


DIMENSION  NPO INT( 7) / KEY! 5) , Z(29),  WEIGHT(29) 

PRESET  NPOINT/  KEY,  Z,  ANO-VEIGHT  ARRAYS 

DATA  KEY!  t ),KEY(2),  KSY!3>,KEY!  9),KEY!  5)  ,KEY(6),KEY(  7)  , K^YCS) 

/ 1/  2/  9,  6/  9/  12/  17,  25  / 

DATA  NPO  I. NT  ( ! ) / N.°0 1 NT  < 2 > / N PO I NT  C 3 ) / N PO I NT  ( A ) / NPO  I NT  C 5 ) 

N °OINT  (6),NPQINT(7) 

/ 2,  3/  A,  5/  6/  10/  15  / 

DATA  E(l)/  ECS),  Z<3),  ECO),  2(5),  E( 6) / Z(7),  ECfi),  E(9)/E<10)/ 

Ed  l >, Zd 2), Z (13), 2!  l9),2d5),Zd6>,I(17),Zd5),2d9),2(20), 

ZC2I),Z(22),2<23),Z<24) 

/ 0.577350/  0.0  , 0.770597/ 

0.339951,  0.H61I36,  0.0  / 0.536969, 

0.906150,  0.235619,  0.661209,  0.932970/ 

0. 1A557A,  0.933395/  0.679410,  0.565063/ 

0.973907,  0.0  , 0.201199/  0.399151/ 

0.5709  72,  0.  ''299  1 5/  0.595207/  0.937273/ 

0.9R79-)3  / 

DATA  WEIGHT!!),  WEIGHT<2>,  WEIGKTC3),  WEIGHTC9),  WEIGH 

T 

WEI GKT ( 6) , WEI GKT  < 7) , WEIGHT(B),  WEI GHT<9), WEI GHT  ' 

C 

WEI GHT ( 1 1 ) > WEI GHT< 12), WEIGHT! 13), WEIGHT! 19), WEIGH 

T 

WEIGHT! 16) / WEI GKT! I 7) , WEI GKT! 1 5>, WEI GHT! 19), WEIGH 

T 

WEI GHT! 21), WEI GHT! 22), WEIGHT! 23), WEIGHT! 29) 

/ 1.0  , 0.555559,  0.555556/ 

0.652195/  0.397555/  0.565559/  0.97B629, 

0.236927,  0.967919/  0.360762/  0.171324/ 
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0 

]j 

0 


0.295524,  0.269267,  0.219086,  0.149451* 

9 0.066671,  0.202574,  0. 198431,  0. 186161, 

A 0.166269,  0.139571,  0.107159,  0.070366, 

8 0.030753  /, 

C . 

C FI  MO  81186091 PT  C FIRST  £ AMD  WEIGHT  VALUE 

C 

DO  I ! * 1 , 7 

IF<M.E9.MPQINT<I)>  GO  TO  2 

1 CONTINUE 

C . . 

0 INVALID  M USED 

C 

AREA=«0. 

RETURN 

C 

C SET  UP  INITIAL  PARAMETERS 

0 

2 UFI  RST=»KEY(  I J 

•JLAST=»KEYCI>  1)  - I 

C=CY-X)/2. 

0=<Y+X>/2. 

C 

C ACCUMULATE  THE  SUM  IN  THE  >1- POINT  FORMULA 

C 

8UM30. 

DO  5 .;=».IFIRST,.JLAST 

IFCZ(.J)  .EO.O.)  SUM-81J-'  + VEIGHT(J)*G1(D> 

5 IF(EC-J)  .NE.O.)  SUMs 6liM  + WEIGHT(.I>*<G1  CSU.j>*c  + D) 

1 ♦ GI(-?(.J)*C  ♦ D)> 

C 

0 MAKE  INTERVAL  CORRECT  !'i,N  AMD  RETURN 

a 

AREA*C*  SUM 

RETURN 

END 


c 

c 


FUNCTIOM  CALLEO  RV  GAUSS  I C CJ'.HERATOR) 
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1 


FUNCTION  GKWOTS) 

CON-ION  XK250)/  X2(2S0>»  t.'JDMOO),  ABRN  0(  1 00) , ABM0(100)> 

I AHRM  t < 1 00)  • ARI.1U100>>  C*  At  OAQ/  CONST,  A0C80,  A0S80,  N,  NIJ-1 
C 

ss=»o. 

00  10  1=1, NUN 

ARG=  FLOAT! INO( I >- 1 > * WOTS 
10  SS*  SS  ♦ ABRN 1!I>*C0S!  ARU)  - ABM  l < I >*SIN<  ARG) 

SS-Ci>SS  + AOCBOttCOS  ! FLOAT ( 1 >*W‘OTS)  - AOSBO*SIN!  FLOATiM-  1 > *WOTS) 

G1=*C0NST*EXP!  SS> 

RETURN 

END 


i 

i 
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SUBROUTINE  GAMSS2!X,Y,M,  AREA) 

C 

C SUBROUTINE  GAUSS  USES  THE  .M- POINT  GAUSS -LEGENDRE  QUADRATURE 

C FORMULA  TO  CO-1PUTF.  THE  INTEGRAL  OF  G200*DX  BETWEEN 

C ' INTEGRATION  LIMITS  X AND  Y«  THE  ROOTS  OF  SEVEN  LEGEND 
E H 

C POLYNOMIALS  AND  THE  WEIGHT  FACTORS  FOR  THE  CORRESPONDING 

G QUADRATURES  ARE  STORED  IN  THE  L AND  WEIGHT  ARRAYS 

C RESPECTIVELY.  M MAY  ASSUME  VALUES  2,3,4, 5, 6, 10.  AND  15 

C ONL'f . THE  APPROPRIATE  VALUES  FOR  THE  M-POINT  FORMULA  ARE 

C LOCATED  IN  ELEMENTS  Z!KEY!i>,  ...  , Z <KEY!  I + 1 ) - I ) AND 

C WEI GHT! KEY! l ) ) , ...  > WEI GHT! KEY ! I+  !)-  1 > WHERE  THE  PROPER 

C VALUE  OF  I IS  DETERMINED  SY  FINDING  THE  SUBSCRIPT  OF  THE 

C ELEMENT  OF  THE  ARRAY  MPOINT  WHICH  HAS  THE  VALUE  M.  IF  AN 

C INVALID  VALUE  OK  M IS  USED.  A TRUE  ZERO  IS  RETURNED  AS  THE 

C VALUE  OF  GAUSS. 

C 

DIMENSION  N POINT! 7) , KEY!3),  Z!24>,  VEIGHT{24> 

C 

C PRESET  NP01NT,  KEY.  Z,  AND  WEIGHT  ARRAYS 

G 

DATA  KEY! 1),KEY!2V . KEY! 3) , KEY! 4 ) » KEY! 5) . KEY! 6) , KEY! 7) . X EY( 8)  . 

I / 1.  2.  4.  6.  9.  12.  17.  25  / 

C 

DATA  NPOINT! 1 ) , NPO I NT!  2>  , NPOi  NT  ! 3 > , NPOI  NT!  4)  , NPOI  NT!  5)  , 

1 NP01NT!6).NP0INT!7) 

2 / 2.  3.  4.  5.  6.  10.  15  / 

C 

DATA  Z!  I ) . Z ! 2) . Z!3>.  Z!4>.  Z!5>.  Z!6)»  Z!7),  Z!8).  Z!9),Z!10). 
1 Z! I !).Zt !2) . Z<  13), 2! 14). 2 ( 1 S) . Z! 16) . Z!  1 7) , Z! 18) , Z! 19). 2(20). 


2 Z! 2 1 ) . Z! 22) . 2! 23) .2! 24) 

3 / 0.577350.  0.0  . 0.774597. 

4 0.339901,  0.061136,  0.0  , 0.538469, 

5 0.906 1 8 9.  0.238619,  0.661209,  0.932470, 

6 0.148874,  6.433395,  0.679410,  0. 868063, 

7 0.973907,  n.g  , 0.201194,  0.394151, 

8 0.570972,  0.724418.  0.348207,  0.937273, 

6 0.987993  / 


!E)  * 

10), 

! 15), 


1 

2 


DATA  WEIGHT!  1),  VF,IGHT!2),  WEIGHT<3),  WEIGHT!4),  WEIGH 

T 

WEi GHT! 6),  WEIGHT<7),  WEIGHT!8),  WEI GHT!9), WEI GHT 

< 

WEIGHT! I 1), WEIGHT! 12). WEIGHT! 13), WEI GHT! 14), WEIGH 
T 


3 • 

!20), 

4 

5 

6 
7 


WEIGHT! 16). WEIGHT! 17), WEIGHT! 18), WEIGHT! 19), WEIGH 
T 

WEI  GHT!  21),  WEI  GHT!  22),  WEI  GHT!  23),  WEI  GHT!  24) 

/ 1.0  , 0.838889,  0.555556, 

0.652145,  0.347855,  0.568389,  0.473629, 
0.236927,  0.467914,  0.360762,  0.171324, 


3 0. 295524*  0.269267*  0*219086*  0.149451* 

9 0.066671*  0.202573*  0.198431*  0.186161* 

A 0.166269*  0.139571*  0.107159*  0.070366* 

8 0.030753  / 

C 

C FIND  SUBSCRIPT  OF  FIRST  4 AMD  WEIGHT  VALUE 

0 

00  1 1*1*7 

IF<.M.£Q*NPOINT<  I ) > GO  TO  2 
l COMTINUE 

C 

C INVALID  M USED 

C 


ABEA*0. 

RETURN 


0 

C SET  UP  INITIAL  PARAMETERS 

C 

2 J F'  RST*K  EY<  I ) 

•JLAST*KSY(  1+  1 ) - t 

C=(Y-X>/2. 

o*<Y+x;/2. 

C 

C ACCUMIIL  ATE  THE  SUM  IN  THE  M-FOI.MT  FORMULA 

0 

SUM*0. 

DO  5 J*JFIRST*.JLAST 

1 F(  4(%J)  . EU.  0.  ) SUM*  SUM  * WEI  GUT  C m B2(  D> 

5 I FI  4CJ>  ..ME.  0.  ) SUM*  SUM  + WEI  GHT  C-J  > * C G2  C 4 CJ>  *C  + D) 

1 + 02  +■  D>) 

C 

C MA<E  INTERVAL  CORRECTION  AMD  RETURN 

C 

AREA*"*  SUM 

RETURN 

END 


easaaa  i * ;r  <juwii&u 


i j ; 0 FMMCTI  O'i  CAUL  SO  8Y  GAUSS2  < Dfirtl)  1 1 N AT08) 

v '■* 

FUNCTION  G2(W0TS) 

■ f CONNON  Xl(350)i  X9(2SO)/  i*IO<IOO)/  A8R>10(100>z  A8M0(100)> 

f j t AB8N  I ( 1 00)  > A8i  Hid  00)  / C>  AI  OAO/  CONST/  A0C80/  A0S80/  NIM 

: 1 ■ c 

ss=o. 

. ( DO  10  1=1/ MUM 


A8G=  FLO  AT  ( INO(t)-l)  * WOTS 
10  SS=  SS  + A8cH0<I)*C0S(  A8U)  - A8M0(  I ) * S 1 N(  AHG) 

SS=C*SS  + AOC  BO#COS  < FLOAT  ( N- I > # WOTS)  - A0S80*SIN<  FLOATM-  1 >*WOTS> 


C SET  IXX<=251  TO  INITIALIZE 

0 COMMON  X(2S0> 

C $ A DTE2  2 I READS  FROM  DT2 

C 


i SUBROUT  t NE  I N ( Yj  I XXX) 

| , COMMON  X<  25  0) 

IF< I XXX. NE. SSI)  GO  TO  10 
READ!  2)  (X(J>>  J=*1j250> 

, i::xx*t 

j 10  Y=X( I XXX) 

IXXX=»IXXX+1 

RETURN 

; END 


VfiTTi~rtfflii 


. "h  ■■  K:rA":  - X*.V,  >4-.  • 


< * .*  V*  <**  '/*;-'  •f'S'W'f^V  £ ,*; 

-i ,...  ~7  I II  i.iwioiiiiij 
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0 GENERAL  OUTPUT  HANDLER 

G 

G SET  IYYY=*l*  I SLOCK*  0 TO  INITIALIZE 

C COMMON  XI<aSO>»  X<2!50> 

C SA  OTFi  I t WRITES  ON  DTI 

C 

SUBROUTINE  OUT< Y* IYYY* I BLOCK) 
COMMON  X 1 < 250) * X<2S0> 

XUYYY)-Y 
IYYY=»IYYY+  * 

IF<IYYY.NE./!f<l)  GO  TO  10 
WRITEU)  <XCJ)>  J*  1*250) 

I YYY* 1 

I BLOCK* I BLOCK* 1 
10  RETURN 

END 


0 

0 

0 

0 

0 


f! 

mmt 

0 

0 

0 


D 


0 


(i 


* 


C ORDER  HANDLER 

C, 

C WRITES  IN  INCREASING  ORDER  THE  L*N<-  t PROOUCT  VALUES 

C 

SURROUTINE  ORDER! M/ K 1/ IN/ NUM) 

DIMENSION  IN(IOO) 

NIIM30 

DO  10  1= 1/ ! 00 
10  IN!I)*0 

DO  30  M 1=  1/M 
DO  20  L*!/K1 
I ND3  <MI-1)*LM 
20  I N< I ND) 3 1 

30  CONTINUE 

DO  40  1*1/100 
imtHD.NS.  1)  GO  TO  40 
N»M*NUMM 
INIM1JM  ) 3 1 
40  CONTINUE 

WRITE! 6/ S0> 

50  FORMAT! //SX/20HL*N* I PRODUCT  VALUES/) 

WRITE ! A,  60)  !IN!.J)/  J* 1/NUM) 

60  FORMAT < 2Xz  5! I 3/ 5X) ) 

RETURN 

END 


C SUBROUTINE  TO  SKIP  ISKIH  BLOCKS  OF 

C ' .’SO  NUMBERS/BLOCK  STORED  ON  DTI 
C 

C SA  OTFI  I 

SUBROUTINE  SKIP! I,  ISKI  P> 

DIMENSION  X<2SO> 

DO  10  K=  \,  l SKIP 
10  REAOCIJ  J*I,S50) 

RETURN 

END 


SURROUTINE  RESNISCX,  1AX,  FI, PI) 

THIS  SUBROUTINE  CALCULATES  THE  MODIFIED  BESSEL  FUNCTION 
FIC  1)310(X)>  Ft  <2)  3 I I <X),  ...»  FI  ( N4AX)  = I < UMAX-  1 ) ( X) 
OI'/IOE  Vf  0 ERROR  IF  X=0. 

DOES  NOT  CUEC<  FOR  X LESS  THAN  0. 

DIMENSION  FI  (50).  PI  (900) 

SIM»0. 

I=>X 

•J  "lAXa  1*21 
T?.=  9./X 
PI  (.HAX*2)*0. 

°I (UMAX* I>= l .E-20 
DO  1 ■}-  l , ,JXAX 
AX*2-.J 
OX**- 1 

pi  <;<- 1 > = ik*tz*»i  <H)  *pi  (;<*  i > ' 

SUH-S"H*-PI 

S'M=SIM*SIM 
A*EX°(X)/<PI<  !)*SUM> 

DO  2 N*  I,!nHAX 
FI  < N ) i a* PI  (N) 

RETURN 

END 


n o n o a 
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PROGRAM  CALCULATES  PD  AND  PF 
SA  0TF2  2 

PROGRAM  CALLS  SUBROUTINES  PDPF.M#  IN#  AND  SKIP 

DOUBLE  PRECISION  PD# PF 
REAO<  S#  5)  I SKIP 
S FORMAT! 13) 

READ! 5# 10)  N 
10  FORMAT! I 5) 

READ! 5# IS)  POO 
IS  FORMAT! F7 .6) 

1 READ! 5# 20)  THRESH 

IF! ISKIP.NE.O)  CALL  SK I PI  2# I SKI P) 

GO  FORMAT! FS. 2) 

call  pc°fm i thresh# n# pdo# po# pf> 

WRITE! 6#  30)  PF#  PO 

30  FORMAT!  2X,  3HPF*#  D 1 3 . 5K#  3HPD=>#  D 1 3 . 6) 

REWINO  2 
GO  TO  I 
STOP 
ENO 
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&Sl 


V 
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SUBROUTINE  CALCULATES  PE  AND  PO 

fror  n values  of  l under  ho 
SA  DTF3  3 

CALLS  SUBROUTINE  IN 

SUBROUTINE  POPFN<THRESH,N,  POO»  PD> PF) 

DOUBLE  PRECISION  PD, PF* PROP 

PF^O. 

PD*  POO 
I NKK*3S1 

PROD* I ./F^OAT(N) 

00  10  I=*l,N 
CALL  IN(Y, IXNY) 

IFIY.LT. THRESH)  GO  TC  10 

PF=  PF  + PRO 9 

PD*  PD  * Yk PROP 

CONTINUE 

RETURN 

END 
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